in reply to Re^2: Out of memory issue
in thread Out of memory issue

How about not storing all the paths into this huge array but processing each path immediately?

If this is not possible because you need to do some sorting, how about presorting and storing the paths into (for example) 5-10 files and then reading each file separately.

Replies are listed 'Best First'.
Re^4: Out of memory issue
by ralphch (Sexton) on Mar 19, 2010 at 01:33 UTC

    Thanks for your reply. I have now increased the kernel datasize to 1 GB to see if this works (currently running the script again.

    However, I'll be making optimizations to the code to try to reduce the amount of memory it uses. I'll keep you updated.

[reply]

In Section Seekers of Perl Wisdom