Nothing jumps out at me either. But an easy change would be to open each file just once at the beginning, rather than every time you access it. Aside from moving the open() statements, the only change I think this entails is doing a

tell LARGEFILE, 0, 0;

at the beginning of the loop that traverses the records in @REFFILELIST.

You might get a speed improvement by restructuring your script to only read through LARGEFILE once. But this changes the order of your output, and maybe you need the output in the order your script provides.

This is not relevant to your problem as far as I can tell, but if you plan to develop your Perl skills, you might want to develop the habit of using three-argument open() and lexical file handles everywhere (like you did for your output file)

In reply to Re: Out of Memory Error : V-Lookup on Large Sized TEXT File by Anonymous Monk
in thread Out of Memory Error : V-Lookup on Large Sized TEXT File by TheFarsicle

Title:
Use:  <p> text here (a paragraph) </p>
and:  <code> code here </code>
to format your post, it's "PerlMonks-approved HTML":


  • Posts are HTML formatted. Put <p> </p> tags around your paragraphs. Put <code> </code> tags around your code and data!
  • Titles consisting of a single word are discouraged, and in most cases are disallowed outright.
  • Read Where should I post X? if you're not absolutely sure you're posting in the right place.
  • Please read these before you post! —
  • Posts may use any of the Perl Monks Approved HTML tags:
    a, abbr, b, big, blockquote, br, caption, center, col, colgroup, dd, del, details, div, dl, dt, em, font, h1, h2, h3, h4, h5, h6, hr, i, ins, li, ol, p, pre, readmore, small, span, spoiler, strike, strong, sub, summary, sup, table, tbody, td, tfoot, th, thead, tr, tt, u, ul, wbr
  • You may need to use entities for some characters, as follows. (Exception: Within code tags, you can put the characters literally.)
            For:     Use:
    & &amp;
    < &lt;
    > &gt;
    [ &#91;
    ] &#93;
  • Link using PerlMonks shortcuts! What shortcuts can I use for linking?
  • See Writeup Formatting Tips and other pages linked from there for more info.