in reply to Sudden problems with LWP::UserAgent

Have you tried acessing the page with a browser?

Could it be that you need to get a new cookie (I think you are storing and reusing cookies).

Have you tried setting the user-agent to that of the google-bot?

  • Comment on Re: Sudden problems with LWP::UserAgent

Replies are listed 'Best First'.
Re^2: Sudden problems with LWP::UserAgent
by udaybhaskar (Initiate) on Oct 28, 2010 at 05:46 UTC
    I did not try google bot. But I did try RobotUA of LWP and that didnt help either. I will investigate further and update once successful.

    Thanks Uday

[reply]
      I got it working again. Looks like they now expect 
      'Accept' => 'text/html,application/xhtml+xml,application/xml;q=0.9,*/*
+;q=0.8',

      [download]

      as a header field. I however am plugging in all the http headers that firefox uses for my pages of interest so that I don't end in this trouble again.

      Thanks and Regards
      Uday
[reply]
[d/l]
        thanks a lot :-) .. you saved my time and life ... Uday !!!
[reply]

In Section Seekers of Perl Wisdom