in reply to Re: LWP::UserAgent Bad and Forbidden requests
in thread LWP::UserAgent Bad and Forbidden requests
In general, changing your user agent string to spoof Firefox, for example, is not a legitimate workaround. LWP::UserAgent is kind of a grey area, since you could use it to build interactive, as well as automated web applications. However, the folks at sciencedirect.com are clearly taking a hard line against it. If taioma chooses to spoof his user agent from a spider, and it is detected, he could get himself (and his whole company) banned.
Cheers,
Larry
|
|---|
| Replies are listed 'Best First'. | |
|---|---|
|
Re^3: LWP::UserAgent Bad and Forbidden requests
by tobyink (Canon) on Dec 15, 2011 at 21:06 UTC | |
|
Re^3: LWP::UserAgent Bad and Forbidden requests
by Anonymous Monk on Dec 15, 2011 at 22:11 UTC |