While not directly related to your problem, sometimes people do block access to their pages for robots. Maybe the page is blocked for" LWP-UserAgent/$Yourversion"?