in reply to Perl module for downloading web pages

The standard modules for this stuff are in LWP, but if you want a higher level of abstraction for wandering round the web, you could try WWW::Robot. It's good at following links.

And in general, you should use WWW::RobotUA from the LWP distribution if you're going to be doing a lot of automatic screen scraping.

andramoiennepemousapolutropon

  • Comment on Re: Perl module for downloading web pages