SOLVED in the update at the end. I need to parse a continuous XML stream coming from a device via http. The problem I run into is I can't find a way to convince PerlSAX to take a URL as a source. There's no good way to "download" the XML and hand it off to the XML parser because the download is never going to finish (continuous stream).

# This is the URL that streams alerts such as motion detection. Docume
+ntation at goo.gl/S38ZQq
my($url) = "http://".$user.":".$password."@".$ip.":".$port."/ISAPI/Eve
+nt/notification/alertStream";
#start an instance of SAX parser for each monitor
my $handler = SAXAlertStreamHandler->new();
my $parser = XML::Parser::PerlSAX->new( Handler => $handler );
my %parser_args = (Source => {SystemId => $url});
$parser->parse(%parser_args);
exit;

Couldn't open http://user:password@10.1.10.23:80/ISAPI/Event/notificat
+ion/alertStream:
No such file or directory at /usr/local/share/perl/5.18.2/XML/Parser/P
+erlSAX.pm line 146.

[download]

Update: Based on the great information found here, I did determine that preprocessing the data was required. LWP has the ability to process with a handler. As a really nice side-effect, the LWP handler seems to automatically call the handler for each part of the multpart stream so I don't need to set the read_size_hint. For even better multipart http handling, see Alexander's MultipartFilter.pm module. Below is my working code

#!/usr/bin/perl 

use XML::Twig;
use warnings;
use strict;
use LWP;

my $url =
'http://username:password@10.0.0.1/Event/notification/alertStream';
my $browser = LWP::UserAgent->new();

my $twig =
  new XML::Twig(
    twig_handlers => { EventNotificationAlert => \&AlertStreamHandler 
+} );

my $response = $browser->get(
    $url,
    ':content_cb'     => \&raw_handler,
    ':read_size_hint' => 1024,
);

sub raw_handler {
    my ( $data, $response ) = @_;
    unless ( $data =~ /^--boundary/ ) {
        $twig->parse($data);
        #print $data;
    }
}

sub AlertStreamHandler {
    my ( $twig, $eventAlert ) = @_;
    my $ip        = $eventAlert->first_child('ipAddress')->text;
    my $eventType = $eventAlert->first_child('eventType')->text;
    print "IP: " . $ip . "\n";
    print "Event: " . $eventType . "\n";
    $twig->purge;                             # delete the twig so far
+. Not sure if this is needed.
}

[download]

In reply to SOLVED: XML Parsing from URL by jshank

Title:
Use:  <p> text here (a paragraph) </p>
and:  <code> code here </code>
to format your post, it's "PerlMonks-approved HTML":


  • Posts are HTML formatted. Put <p> </p> tags around your paragraphs. Put <code> </code> tags around your code and data!
  • Titles consisting of a single word are discouraged, and in most cases are disallowed outright.
  • Read Where should I post X? if you're not absolutely sure you're posting in the right place.
  • Please read these before you post! —
  • Posts may use any of the Perl Monks Approved HTML tags:
    a, abbr, b, big, blockquote, br, caption, center, col, colgroup, dd, del, details, div, dl, dt, em, font, h1, h2, h3, h4, h5, h6, hr, i, ins, li, ol, p, pre, readmore, small, span, spoiler, strike, strong, sub, summary, sup, table, tbody, td, tfoot, th, thead, tr, tt, u, ul, wbr
  • You may need to use entities for some characters, as follows. (Exception: Within code tags, you can put the characters literally.)
            For:     Use:
    & &amp;
    < &lt;
    > &gt;
    [ &#91;
    ] &#93;
  • Link using PerlMonks shortcuts! What shortcuts can I use for linking?
  • See Writeup Formatting Tips and other pages linked from there for more info.