in reply to Re: Iterating through HUGE FILES
in thread Iterating through HUGE FILES

So that WAS the problem. I know there was some compiled-in limit. Thank you for mentioning this.

If this is the problem (which seems likely) with the original poster's code, again I suggest using other utilities to break up the data set into manageable chunks, and then processing those chunks in perl.

Replies are listed 'Best First'.
Re^3: Iterating through HUGE FILES
by mobiGeek (Beadle) on May 12, 2005 at 03:50 UTC
    Other utilities, like say: cat HUGE | perl my_script.pl

    ...This is, of course, bait for Merlyn to jump all over :-)

    Seriously though, can you simply read from STDIN ? Then your Perl shouldn't care how big the file is.