in reply to Recursive HTTP Downloads - without using WGET

May I recommend Higher Order Perl by Mark Jason Dominus (it is freely available, but also purchasable). Chapter 4.7 "An extended example: Web spiders"

The code he presents uses LWP::Simple and lacks cookie support, but I don't think it would be difficult to modify it to fit your needs.

  • Comment on Re: Recursive HTTP Downloads - without using WGET