As mentioned, LWP is probably much better than what you're trying.. If you want to experiment, you might look at the LWP::UserAgent module.. it is cool because it has great options and you can politely identify yourself. However I found the documentation a bit abstruse.. so below is a quick example that might help..
use LWP;
my $finaldata;
my $query_url = 'http://www.bla.com/';
sub get_pagesum {
+
my $ua = LWP::UserAgent->new( agent => 'http://mysite.com/');
+
my $response = $ua->get("$query_url",
+
':content_cb' => \&gen64,
+
);
+
}
+
+
sub gen64 {
+
my($data, $response, $protocol) = @_;
+
return $finaldata .= $data;
+
}
# whatever you got off the last request
# should now be contained in $finaldata
(In my case I was sending $finaldata off to be md5 checksummed.)
Of course, if your file contains a list of URLs you must fetch, then you'll be carrying out the procedure for each line in the file...
-
Are you posting in the right place? Check out Where do I post X? to know for sure.
-
Posts may use any of the Perl Monks Approved HTML tags. Currently these include the following:
<code> <a> <b> <big>
<blockquote> <br /> <dd>
<dl> <dt> <em> <font>
<h1> <h2> <h3> <h4>
<h5> <h6> <hr /> <i>
<li> <nbsp> <ol> <p>
<small> <strike> <strong>
<sub> <sup> <table>
<td> <th> <tr> <tt>
<u> <ul>
-
Snippets of code should be wrapped in
<code> tags not
<pre> tags. In fact, <pre>
tags should generally be avoided. If they must
be used, extreme care should be
taken to ensure that their contents do not
have long lines (<70 chars), in order to prevent
horizontal scrolling (and possible janitor
intervention).
-
Want more info? How to link
or How to display code and escape characters
are good places to start.
|