I have used WWW::Mechanize, this is quite a good module for any screen scraping kind of stuff. OTOH, you can read these threads here in perlmonks:

1. Web Spidering module?
2. Unique spidering need
3. simple search perlmonks for spidering