in reply to Processing LARGE text files

Don't read line by line or slurp in the whole file. Read in one delimited section at a time. For example if your delimiter is "end of record\n", do this:
local $/ = "end of record\n";
while(<>) {
  # process a delimited section if matches your criteria
}

[download]
-imran

Replies are listed 'Best First'.
Re^2: Processing LARGE text files
by Craig720 (Initiate) on Mar 07, 2006 at 20:39 UTC
    Thanks for the reply. Your suggestion does make sense.

    I think I tried 'chunking' once. Didn't work out too well. I experienced 'Sudden Flaming Death' -- my error message. I'll have to give your method another try in the morning when I'm fresh.

    Thanks for the tip. I'll see what happens.

[reply]

In Section Seekers of Perl Wisdom