Re^4: Pulling a Page with LWP::UserAgent and fixing URLs?

URI::URL is only used for old stuff.. backward compatibility and all that, Looks like URI is the one, however using this are you saying i should parse out all the URL's and then use this to fix them and put them in.. or could i do a regexp with /e on the end and do it all in one line?

Comment on Re^4: Pulling a Page with LWP::UserAgent and fixing URLs?

Replies are listed 'Best First'.
Re^5: Pulling a Page with LWP::UserAgent and fixing URLs? by teabag (Pilgrim) on Nov 10, 2004 at 14:30 UTC
I mean fixing the url to convert relative to absolute pathnames. Just include tokeparser as suggested and you're there. something like this: (btw. not my code from http://perl.com): `#!/usr/bin/perl use strict; use warnings; use LWP; use URI; my $browser = LWP::UserAgent->new; my $url = 'http://www.cpan.org/RECENT.html'; my $response = $browser->get($url); die "Can't get $url -- ", $response->status_line unless $response->is_success; my $html = $response->content; while( $html =~ m/<A HREF=\"(.*?)\"/g ) { print URI->new_abs( $1, $response->base ) ,"\ +n"; }` [download] teabag -- Siggy Played Guitar Sure there's more than one way, but one just needs one anyway - Teabag	[reply] [d/l]

Replies are listed 'Best First'.

Re^5: Pulling a Page with LWP::UserAgent and fixing URLs?
by teabag (Pilgrim) on Nov 10, 2004 at 14:30 UTC

http://perl.com

#!/usr/bin/perl
use strict;
use warnings;
use LWP;
use URI;

  my $browser = LWP::UserAgent->new;

      my $url = 'http://www.cpan.org/RECENT.html';
        my $response = $browser->get($url);
          die "Can't get $url -- ", $response->status_line
             unless $response->is_success;

                 my $html = $response->content;
                   while( $html =~ m/<A HREF=\"(.*?)\"/g ) {
                         print URI->new_abs( $1, $response->base ) ,"\
+n";
                           }
[download]

teabag

-- Siggy Played Guitar

Sure there's more than one way, but one just needs one anyway - Teabag

[reply]
[d/l]