Certainly LWP::* is what you want.

However as you read up on the documentation, do not neglect the stuff about how to follow robots.txt. What you are building is a webspider, and to be a good netizen you need to pay attention to the rules and not slam websites that have asked you not to slam them...