What is your configuration (Perl, OS, architecture)? A 17MB XML file should only be around 170MB once loaded in memory. It seems though that on a 64 bit architecture it could take a lot more, I can't tell, I don't have a 64-bit machine around.

That said, XML::Twig was designed just for this type of situation, to avoid having to load the entire document.

From your example (as Tanktalus mentioned, it would be better to put it in your node, at least I could look at it while answering), you do have access to attributes of the englobing tag within the nested elements. In a handler on the directory element, $directory->parent->att( 'info') is available. Alternatively, you can use the start_tag_handlers option to grab the info from the englobing tag and do something with it,without having to wait to parse the entire element.

In reply to Re: XML::Twig segfaulting on large docs by mirod
in thread XML::Twig segfaulting on large docs by Catharsis

Title:
Use:  <p> text here (a paragraph) </p>
and:  <code> code here </code>
to format your post, it's "PerlMonks-approved HTML":


  • Posts are HTML formatted. Put <p> </p> tags around your paragraphs. Put <code> </code> tags around your code and data!
  • Titles consisting of a single word are discouraged, and in most cases are disallowed outright.
  • Read Where should I post X? if you're not absolutely sure you're posting in the right place.
  • Please read these before you post! —
  • Posts may use any of the Perl Monks Approved HTML tags:
    a, abbr, b, big, blockquote, br, caption, center, col, colgroup, dd, del, details, div, dl, dt, em, font, h1, h2, h3, h4, h5, h6, hr, i, ins, li, ol, p, pre, readmore, small, span, spoiler, strike, strong, sub, summary, sup, table, tbody, td, tfoot, th, thead, tr, tt, u, ul, wbr
  • You may need to use entities for some characters, as follows. (Exception: Within code tags, you can put the characters literally.)
            For:     Use:
    & &amp;
    < &lt;
    > &gt;
    [ &#91;
    ] &#93;
  • Link using PerlMonks shortcuts! What shortcuts can I use for linking?
  • See Writeup Formatting Tips and other pages linked from there for more info.