For one thing, you can cut out a number of arrays by combining what you're doing. From a quick glance, you don't seem to be using @xfilenames (and the like) except as a temporary data structure. Instead, do something like:
my @filenames; my @titles; my @headings; my @stuff; foreach (@pages) { chomp; if (/^\*{4}filename.ext\*{4}/) { s/^\*{4}filename.ext\*{4}//; push @filenames, $_; } elsif (m/^\*{4}title\*{4}/) { s/^\*{4}title\*{4}//; push @titles, $_; } elsif (m/^\*{4}heading\*{4}/) { s/^\*{4}heading\*{4}//; push @headings, $_; } else { s/\*{4}stuff\*{4}(.*?)\*{4}endstuff\*{4}/sg; push @xstuff, $_; } }
You now have 4 less lists, thus cutting your memory usage for data structures almost in half.

Note - don't declare all your variables up-front. That's a very C-like thing to do. Declare them when you need them, as you need them. Declaring a list or hash takes up considerable memory, as Perl will pre-declare like 50 (or so) elements that just sit there.

------
/me wants to be the brightest bulb in the chandelier!

Vote paco for President!


In reply to Re: out of memory by dragonchild
in thread errors revisited by maddfisherman

Title:
Use:  <p> text here (a paragraph) </p>
and:  <code> code here </code>
to format your post, it's "PerlMonks-approved HTML":



  • Posts are HTML formatted. Put <p> </p> tags around your paragraphs. Put <code> </code> tags around your code and data!
  • Titles consisting of a single word are discouraged, and in most cases are disallowed outright.
  • Read Where should I post X? if you're not absolutely sure you're posting in the right place.
  • Please read these before you post! —
  • Posts may use any of the Perl Monks Approved HTML tags:
    a, abbr, b, big, blockquote, br, caption, center, col, colgroup, dd, del, details, div, dl, dt, em, font, h1, h2, h3, h4, h5, h6, hr, i, ins, li, ol, p, pre, readmore, small, span, spoiler, strike, strong, sub, summary, sup, table, tbody, td, tfoot, th, thead, tr, tt, u, ul, wbr
  • You may need to use entities for some characters, as follows. (Exception: Within code tags, you can put the characters literally.)
            For:     Use:
    & &amp;
    < &lt;
    > &gt;
    [ &#91;
    ] &#93;
  • Link using PerlMonks shortcuts! What shortcuts can I use for linking?
  • See Writeup Formatting Tips and other pages linked from there for more info.