Any suggestions?

Changing the for loop to a while loop should help.

update:arturo++ for catching my laziness in explaination

should probably explain, why this is. If you use a for loop, you end up pulling in all the lines in the file in one fell swoop (creating the list for the loop), and then iterating over them, which as you have noticed okay for smaller files, but with larger files you are using a lot of memory, and for even larger files, a lot more than memory still, well you get the picture.

On the other hand with the while loop you are only reading in one line at a time, so you don't have to have the huge file in memory all at once.

-enlil

In reply to Re: Big file, system no likey .. by Enlil
in thread Big file, system no likey .. by aaAzhyd

Title:
Use:  <p> text here (a paragraph) </p>
and:  <code> code here </code>
to format your post, it's "PerlMonks-approved HTML":


  • Posts are HTML formatted. Put <p> </p> tags around your paragraphs. Put <code> </code> tags around your code and data!
  • Titles consisting of a single word are discouraged, and in most cases are disallowed outright.
  • Read Where should I post X? if you're not absolutely sure you're posting in the right place.
  • Please read these before you post! —
  • Posts may use any of the Perl Monks Approved HTML tags:
    a, abbr, b, big, blockquote, br, caption, center, col, colgroup, dd, del, details, div, dl, dt, em, font, h1, h2, h3, h4, h5, h6, hr, i, ins, li, ol, p, pre, readmore, small, span, spoiler, strike, strong, sub, summary, sup, table, tbody, td, tfoot, th, thead, tr, tt, u, ul, wbr
  • You may need to use entities for some characters, as follows. (Exception: Within code tags, you can put the characters literally.)
            For:     Use:
    & &amp;
    < &lt;
    > &gt;
    [ &#91;
    ] &#93;
  • Link using PerlMonks shortcuts! What shortcuts can I use for linking?
  • See Writeup Formatting Tips and other pages linked from there for more info.