Mail::Box it is, then.

I searched PerlMonks for "Mail::Box maildir" and came up with a thread titled "Mail::Box fails miserably when trying to open 30_000 messages". But the thread ended with no resolution of the matter.

In light of the thread, perhaps I should break the download from the POP3 server into groups of no more than, say, 20_000 messages? As I mentioned in my original inquiry, I plan to use getmail for the download.

I reviewed the thread you're speaking of. The thread dates back to the year 2005. The module is actively maintained, and while it's possible this was never reported/fixed, it's also probable that this has already been dealt with.

Also, in 2005 the average machine didn't have nearly so much memory as nowadays. If the issue was a memory constraint, it's possible that too has been resolved simply by the application of Moore's Law over the past seven or eight years. Older versions of Perl such as 5.6.2 have mostly fallen by the wayside too, and 5.6, IIRC, was more memory constrained than modern versions.

Or you could be screwed, in which case breaking the download down to under 20k messages seems like a reasonable workaround. But why not code it the way you think you want it to behave (ie, don't worry about breaking down to 20k messages per iteration), and then if you bump into the problem, be ready to report the bug, and/or to code around it.




Dave

Thanks, Dave. Now that I know which module to use, the local PerlMongers group should be able to provide whatever support I need in writing the script.