Re^2: XML::Twig Stream root children

Replies are listed 'Best First'.
Re^3: XML::Twig Stream root children by Anonymous Monk on Oct 03, 2009 at 01:47 UTC
xml_split does not create valid xml documents. Sure it does. Observe `$$ echo THIS IS THE SAME AS xml_split -v Herkum.xml $$ xml_split -v -c "level(1)" Herkum.xml generating main file Herkum-00.xml generating Herkum-01.xml generating Herkum-02.xml $$ cat Herkum-00.xml && echo <root> <?merge subdocs = 0 :Herkum-01.xml?> <?merge subdocs = 0 :Herkum-02.xml?> </root> $$ cat Herkum-01.xml && echo <a> <b>Test</b> </a> $$ cat Herkum-02.xml && echo <aa> <b>Test</b> </aa>` [download] You can use "level(1)" with twig_handlers	[reply] [d/l]
Re^4: XML::Twig Stream root children by mirod (Canon) on Oct 03, 2009 at 16:08 UTC
You can even do `xml_split -l 1`	[reply] [d/l]
Re^5: XML::Twig Stream root children by Herkum (Parson) on Oct 05, 2009 at 14:59 UTC
using the 'level(1)' as the Anonymous Monk suggested does the trick. The question I have now, is where is this documented? I only saw one it mentioned once in the XML::Twig POD and I found an example in the unit tests. Update: I take this back, I did find in the documentation. Though I had never noticed it before. This project has been a good learning experience.	[reply]
Re^3: XML::Twig Stream root children by mirod (Canon) on Oct 04, 2009 at 09:51 UTC
Would you care to explain? I tried to make it output well-formed fragments. About the only thing I can think of that would trip xml_split would be DTDs with entities, and if you have an example, I would be glad to make it work for you. Thanks	[reply]
Re^4: XML::Twig Stream root children by Anonymous Monk on Oct 04, 2009 at 10:51 UTC
Unless I'm overlooking something, a new feature could be to have an option to omit the merge file (00) and instead have the root wrapped around each output file, ie foo.xml `<root> <a> <b>Test</b> </a> <aa> <b>Test</b> </aa> </root>` [download] becomes 2 files, foo-01.xml `<root> <a> <b>Test</b> </a> </root>` [download] and foo-02.xml `<root> <aa> <b>Test</b> </aa> </root>` [download]	[reply] [d/l] [select]
Re^5: XML::Twig Stream root children by mirod (Canon) on Oct 04, 2009 at 20:16 UTC
I may be overlooking something here. The generated "split files" would consist of the 'a' or 'aa', or whatever other level 1 element. So correct me if I'm wrong, but the only thing missing would be the '<root>' first line and '</root>' last line, right? Adding those to each of the files is left as an exercise to the reader.	[reply]
Re^5: XML::Twig Stream root children by Herkum (Parson) on Oct 04, 2009 at 14:02 UTC
I want to break one huge XML document into multiple stand-alone documents. The application that would use this is not smart enough to to handle 'subdocs'. I was also looking at a streaming solution, which is what I assumed twig_handlers would do. The reason is that the document I want to break is 500MB(don't ask, I did not do it!) and there is no way it will fit into memory.	[reply]