in reply to web spider

yes there are so many option that is worth mentioning Web::Scraper too, the author is the brilliant father of the plack and PSGI.
I had some understanding problem with that module, for sure for my limits but is fun and works.

You can also be interested to a two parts article about modern perl web scraping and to general introduction on the matter.

For my common usage i still use LWP::UserAgent.

L*
UPDATE 17 Nov 2015 minor typo fixed
There are no rules, there are no thumbs..
Reinvent the wheel, then learn The Wheel; may be one day you reinvent one of THE WHEELS.