Well don't load em all at once... unless you have a hardware sponsor or your boss doesn't mind you coding bad code :)
LWP::Simple is your friend...
HTML::Parser probably too.
#!/usr/bin/perl -w
use strict;
use LWP::Simple;
for my $i (1..100) {
my $page = get("http://www.some.url.com/$i.html");
foo($page);
}
Greetz
Beatnik
... Quidquid perl dictum sit, altum viditur.