definitely fun, especially after spending all afternoon installing various modules prerequisite to LWP (smiley)

i modified this program so you can say:
www.foo.com/ instead of www.foo.com/index.html
and it reads the url from the command line and just prints the page to stdout
just in case anyone cared
#!/usr/bin/perl
use Socket;
use strict;
                        #i don't know what $line is
my $line;                #but i left it in anyway
my $trailingslash;

my $URL = $ARGV[0];        #get URL from command line
$URL =~ s/http\:\/\///;    #get rid of "http://" if it's there

if ($URL =~ m/\/$/) {        #check for trailing slash 
   $trailingslash = 'true';    #(i.e. get /index.foo)
}
else {
   $trailingslash = 0;
}

my ($HOST,@temppage) = split('/', $URL);
my $PAGE = join('/', @temppage);

if (($trailingslash) && ($PAGE)) { 
    $PAGE = "/$PAGE/";         #reattach the trailing slash
}
else {
    $PAGE = "/$PAGE";
}


socket(HTML, PF_INET, SOCK_STREAM, getprotobyname('tcp')) || die $!;
connect(HTML, sockaddr_in(80,inet_aton($HOST)));

my $REQUEST = "GET $PAGE HTTP/1.0\n\n";
send(HTML, $REQUEST, '');

while(<HTML>)
{
 print;                         #to STDOUT
}
close HTML;

[download]

of course, we could just make the program respond to 301 Moved Permanently. ha.
-b

In reply to RE: Re: Grabbing a Web Page by bobby
in thread Grabbing a Web Page by elusion

Title:
Use:  <p> text here (a paragraph) </p>
and:  <code> code here </code>
to format your post, it's "PerlMonks-approved HTML":


  • Posts are HTML formatted. Put <p> </p> tags around your paragraphs. Put <code> </code> tags around your code and data!
  • Titles consisting of a single word are discouraged, and in most cases are disallowed outright.
  • Read Where should I post X? if you're not absolutely sure you're posting in the right place.
  • Please read these before you post! —
  • Posts may use any of the Perl Monks Approved HTML tags:
    a, abbr, b, big, blockquote, br, caption, center, col, colgroup, dd, del, details, div, dl, dt, em, font, h1, h2, h3, h4, h5, h6, hr, i, ins, li, ol, p, pre, readmore, small, span, spoiler, strike, strong, sub, summary, sup, table, tbody, td, tfoot, th, thead, tr, tt, u, ul, wbr
  • You may need to use entities for some characters, as follows. (Exception: Within code tags, you can put the characters literally.)
            For:     Use:
    & &amp;
    < &lt;
    > &gt;
    [ &#91;
    ] &#93;
  • Link using PerlMonks shortcuts! What shortcuts can I use for linking?
  • See Writeup Formatting Tips and other pages linked from there for more info.