in reply to Web Crawling automatically

You're fairly spoiled when it comes to web-interaction and perl thanks to the LWP suite of modules. If you'd like info on how to use LWP check out the LWP docs and for examples see the lwpcook manpage. If you're doing simple page retrieval check out LWP::Simple which Dog and Pony recently wrote a very informative node on. If it can't be done with LWP then it's not worth doing ;-)
HTH

_________
broquaint