in reply to How to save memory, parsing a big file.

use DBM::Deep;
tie my %total, 'DBM::Deep', $filename;

[download]

Now, you're limited to disk size, not RAM size.

My criteria for good software:
  1. Does it work?
  2. Can someone else come in, make a change, and be reasonably certain no bugs were introduced?

Replies are listed 'Best First'.
Re^2: How to save memory, parsing a big file.
by perl_devel (Friar) on Mar 02, 2006 at 11:07 UTC
    Is there a way to hold the entire log contents itself in to some hash or array without utilising much memmory ,since the file size is too large
[reply]
      The node you replied to is the answer to your question. DBM::Deep is exactly the way to have a hash use disk instead of RAM.
      My criteria for good software:
      1. Does it work?
      2. Can someone else come in, make a change, and be reasonably certain no bugs were introduced?
[reply]

In Section Seekers of Perl Wisdom