I propose some DB too. Here is my notes:

- eXist, open source XML database (http://exist.sourceforge.net/).
Used for huge documents sometimes, XQuery implemented, but, afaik, it is not transactional.

- proprietary solution (which I am implementing for some reasons), XML data in relational database.
Transactions + concurrency are big plus. Need for implementing DOM-like editing functions. Difficult (I have decided that it is not required for my project) implementation of XPath or XQuery. Slow parsing, inefficient data representation, but fast updating.

- stream processing.
It need not nor DB neither huge RAM. You can write proprietary handlers to process XML doc as stream of events, or you can use something like as http://stx.sourceforge.net/

Update: It is very interesting for me. If you want, give me more informations and I will propose some solutions or I can write some code too.

In reply to Re: updating big XML files by pajout
in thread updating big XML files by dHarry

Title:
Use:  <p> text here (a paragraph) </p>
and:  <code> code here </code>
to format your post, it's "PerlMonks-approved HTML":


  • Posts are HTML formatted. Put <p> </p> tags around your paragraphs. Put <code> </code> tags around your code and data!
  • Titles consisting of a single word are discouraged, and in most cases are disallowed outright.
  • Read Where should I post X? if you're not absolutely sure you're posting in the right place.
  • Please read these before you post! —
  • Posts may use any of the Perl Monks Approved HTML tags:
    a, abbr, b, big, blockquote, br, caption, center, col, colgroup, dd, del, details, div, dl, dt, em, font, h1, h2, h3, h4, h5, h6, hr, i, ins, li, ol, p, pre, readmore, small, span, spoiler, strike, strong, sub, summary, sup, table, tbody, td, tfoot, th, thead, tr, tt, u, ul, wbr
  • You may need to use entities for some characters, as follows. (Exception: Within code tags, you can put the characters literally.)
            For:     Use:
    & &amp;
    < &lt;
    > &gt;
    [ &#91;
    ] &#93;
  • Link using PerlMonks shortcuts! What shortcuts can I use for linking?
  • See Writeup Formatting Tips and other pages linked from there for more info.