Re: Having HTML::Parser problem

You might want to consider scraping all of this code, and using the HTML::LinkExtractor facade API (Which is designed to simplify all of this for you).

Comment on Re: Having HTML::Parser problem

Replies are listed 'Best First'.
Re: Having HTML::Parser problem by hacker (Priest) on May 24, 2003 at 13:23 UTC
I used to be a user of HTML::LinkExtor (I've never personally used HTML::LinkExtractor), but I've recently found HTML::SimpleLinkExtor, which works beautifully, and in less code. If you have to install a CPAN module, why not use one that gets your job done faster and easier! Obligatory code (from one of my production projects): `sub extract_links { my $content = shift; my $extor = HTML::SimpleLinkExtor->new(); $extor->parse($content); my %seen; my @hrefs = grep { !$seen{$_}++} $extor->a; my @imgs = grep { !$seen{$_}++} $extor->img; my @fragments = grep {/#/} @hrefs; my @frag = map make_canon($_), @fragments; # Other magical stuff under here to turn relative # links from @imgs and @hrefs into absolute, using # the URI module, and some other hocus pocus. }` [download]	[reply] [d/l]

Replies are listed 'Best First'.

Re: Having HTML::Parser problem
by hacker (Priest) on May 24, 2003 at 13:23 UTC

HTML::LinkExtor

HTML::LinkExtractor

HTML::SimpleLinkExtor

Obligatory code (from one of my production projects):

sub extract_links {
        my $content = shift;

        my $extor = HTML::SimpleLinkExtor->new();
        $extor->parse($content);

        my %seen;
        my @hrefs       = grep { !$seen{$_}++} $extor->a;
        my @imgs        = grep { !$seen{$_}++} $extor->img;
        my @fragments   = grep {/#/} @hrefs;
        my @frag        = map make_canon($_), @fragments;

        # Other magical stuff under here to turn relative
        # links from @imgs and @hrefs into absolute, using
        # the URI module, and some other hocus pocus.
}
[download]

[reply]
[d/l]