One way to do this is to use XML::Twig and Coro: have one thread parse the first input file and an other one parse the other one. Pass control between the 2 threads, after each elem has been parsed:

#!/usr/bin/perl

use strict;
use warnings;

use Coro;
use XML::Twig;
use Test::More;
use Perl6::Slurp;
use autodie qw(open);

my $INPUT_A  = "input_A.xml";  # input file A
my $INPUT_B  = "input_B.xml";  # input file B
my $OUTPUT   = "output.xml";
my $EXPECTED = "expected.xml"; # output file C 

open( my $out, '>', $OUTPUT);

my $times; # global, maybe Coro has a better way to pass it around but
+ I don't know it

my $t1= XML::Twig->new( twig_handlers => { elem => \&main_elem }, keep
+_spaces => 1);
my $t2= XML::Twig->new( twig_handlers => { elem => \&get_times });

# to get the numbers first, before the letters, t2 will be parsed in t
+he main loop          
async { $t1->parsefile( $INPUT_A); };
$t2->parsefile( $INPUT_B); 

print {$out} "\n"; # missing \n for some reason
$t1->flush( $out); 
print {$out} "\n"; # missing \n for some reason

close $out;

is( slurp( $OUTPUT), slurp( $EXPECTED), 'the one test');
done_testing();

sub main_elem
  { my( $t, $elem)= @_;
    $elem->set_text( $elem->text x $times); 
    $t->flush( $out);
    cede;
  }
sub get_times
  { my( $t, $elem)= @_;
    $times= $elem->text;
    $t->purge;
    cede;
  }

[download]

You will need to check that memory is indeed freed after each record. It should be OK, but I don't know exactly how Coro deals with memory, I had never used it before today.

Thank you for asking this and making me look into the problem. And to whoever mentioned Coro yesterday in the CB. This is something I had wanted to do for a long time, but I had always deferred it since I did not really need it for work. Overall it was pretty painless though, the Coro intro is quite well written.

update: also, I should have read Tanktalus answer, above, since he obviously knows Coro a lot better than I do. I am still happy I answered though, at least I learned something.

In reply to Re: Processing Two XML Files in Parallel by mirod
in thread Processing Two XML Files in Parallel by tedv

Title:
Use:  <p> text here (a paragraph) </p>
and:  <code> code here </code>
to format your post, it's "PerlMonks-approved HTML":


  • Posts are HTML formatted. Put <p> </p> tags around your paragraphs. Put <code> </code> tags around your code and data!
  • Titles consisting of a single word are discouraged, and in most cases are disallowed outright.
  • Read Where should I post X? if you're not absolutely sure you're posting in the right place.
  • Please read these before you post! —
  • Posts may use any of the Perl Monks Approved HTML tags:
    a, abbr, b, big, blockquote, br, caption, center, col, colgroup, dd, del, details, div, dl, dt, em, font, h1, h2, h3, h4, h5, h6, hr, i, ins, li, ol, p, pre, readmore, small, span, spoiler, strike, strong, sub, summary, sup, table, tbody, td, tfoot, th, thead, tr, tt, u, ul, wbr
  • You may need to use entities for some characters, as follows. (Exception: Within code tags, you can put the characters literally.)
            For:     Use:
    & &amp;
    < &lt;
    > &gt;
    [ &#91;
    ] &#93;
  • Link using PerlMonks shortcuts! What shortcuts can I use for linking?
  • See Writeup Formatting Tips and other pages linked from there for more info.