Re: Perl module for downloading web pages

Maybe you want start with LWP::UserAgent, and HTTP::Request, both are core modules coming with standard Perl distribution.

If you are familiar with http 1.1 spec, and socket programming, and are interested in details, you can also play with IO::Socket::INET.

Example:

use LWP::UserAgent;
use HTTP::Request;

use strict;

my $agent = new LWP::UserAgent();
my $req = new HTTP::Request(GET => "http://www.google.com");
my $res = $agent->request($req);
print $res->content if ($res->is_success)
[download]

Comment on Re: Perl module for downloading web pages Download Code

Replies are listed 'Best First'.
Re: Re: Perl module for downloading web pages by jdporter (Paladin) on Mar 17, 2003 at 03:44 UTC
...and LWP::Simple. `# poor man's wget: % perl -MLWP::Simple -e "getprint(shift)" http://www.perl.org/ > p +erl.org.index.html` [download] jdporter The 6th Rule of Perl Club is -- There is no Rule #6.	[reply] [d/l]