in reply to LWP::Simple::get($url) does not work for some urls
Update: I think I was totally off and Gangabass is correct below.
Looks like LWP is on their block list. curl appears to be too. If you really need to get something automatically you can set a user agent that isn't blocked. This is just one way:
use WWW::Mechanize; my $mech = WWW::Mechanize->new(agent => "NotBlocked/0.01"); my $url = "http://en.wikipedia.org/wiki/Hotel"; $mech->get($url); print $mech->content;
But they appear to be blocking automatic access intentionally so I suspect it's a TOS violation (this is just a guess). They distribute the DB (I have no idea how but I'm sure they have good docs on it) so you can surely get direct loads of what you're after while respecting their policies.
|
|---|