in reply to Re^9: Incremental XML parsing
in thread Incremental XML parsing

Really, you need a definition of large? My example was if the file couldn't fit on the filesystem. Does that need clarification? And yet another person who didn't read anything else in the thread. I mentioned an existing incremental parser in my OP: XML::SAX::Expat::Incremental, but my problem was it's too slow. Your proposal would be even slower.

Replies are listed 'Best First'.
Re^11: Incremental XML parsing
by Jenda (Abbot) on Feb 05, 2012 at 13:39 UTC

    So it doesn't fit on the filesystem, fine, where does it come from then? If it comes from a socket or another similar source, then just point XML::Rules or XML::Twig at the socket and the data will be parsed as it comes and the defined handlers will get called as soon as a defined logical unit (read ... tag with its children) is complete. What do you keep in memory or on the disk after processing that logical unit is up to you.

    Stop looking for something containing the word "incremental" in its name!

    Jenda
    Enoch was right!
    Enjoy the last years of Rome.

Re^11: Incremental XML parsing
by Anonymous Monk on Feb 05, 2012 at 12:24 UTC

    Your proposal would be even slower.

    I doubt it