Re: LWP::UserAgent gets 403 when other browser does not

WWW::Mechanize supports user agent aliases right out of the box. I too lean toward robot detection via signature, and suggest either Firefox or IE as your most-likely-to-be-accepted alternatives.

Comment on Re: LWP::UserAgent gets 403 when other browser does not

Replies are listed 'Best First'.
Re^2: LWP::UserAgent gets 403 when other browser does not by ikegami (Patriarch) on Jul 01, 2010 at 23:46 UTC
So does LWP::UserAgent. The only difference is that WWW::Mechanize provides these aliases: 'Windows IE 6' => 'Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5. +1)', 'Windows Mozilla' => 'Mozilla/5.0 (Windows; U; Windows NT 5.0; en-US; +rv:1.4b) Gecko/20030516 Mozilla Firebird/0.6', 'Mac Safari' => 'Mozilla/5.0 (Macintosh; U; PPC Mac OS X; en-us) +AppleWebKit/85 (KHTML, like Gecko) Safari/85', 'Mozilla' => 'Mozilla/5.0 (Macintosh; U; PPC Mac OS X Mach-O; +en-US; rv:1.4a) Gecko/20030401', 'Linux Mozilla' => 'Mozilla/5.0 (X11; U; Linux i686; en-US; rv:1.4) +Gecko/20030624', 'Linux Konqueror' => 'Mozilla/5.0 (compatible; Konqueror/3; Linux)', [download]	[reply] [d/l]

Replies are listed 'Best First'.

Re^2: LWP::UserAgent gets 403 when other browser does not
by ikegami (Patriarch) on Jul 01, 2010 at 23:46 UTC

'Windows IE 6'    => 'Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.
+1)',
'Windows Mozilla' => 'Mozilla/5.0 (Windows; U; Windows NT 5.0; en-US; 
+rv:1.4b) Gecko/20030516 Mozilla Firebird/0.6',
'Mac Safari'      => 'Mozilla/5.0 (Macintosh; U; PPC Mac OS X; en-us) 
+AppleWebKit/85 (KHTML, like Gecko) Safari/85',
'Mozilla'         => 'Mozilla/5.0 (Macintosh; U; PPC Mac OS X Mach-O; 
+en-US; rv:1.4a) Gecko/20030401',
'Linux Mozilla'   => 'Mozilla/5.0 (X11; U; Linux i686; en-US; rv:1.4) 
+Gecko/20030624',
'Linux Konqueror' => 'Mozilla/5.0 (compatible; Konqueror/3; Linux)',
[download]

[reply]
[d/l]