in reply to Trying to fetch Google results via TreeBuilder: 403 Forbidden

Why?

Because you're not asking in the way that google likes to be asked (the headers, the request, its not what google wants)

And how can I get the actual result(s) instead?

Consult google documentation

If it works from firefox, duplicate the firefox headers, yeah you may have to use WWW::Mechanize for the actual fetching instead of new_from_url

  • Comment on Re: Trying to fetch Google results via TreeBuilder: 403 Forbidden

Replies are listed 'Best First'.
Re^2: Trying to fetch Google results via TreeBuilder: 403 Forbidden
by jekyll (Acolyte) on Oct 14, 2015 at 09:40 UTC

    \o,

    Google's documentation suggests me to build my own Custom Search. That's annoying.

    WWW::Mechanize works indeed, thanks. :-)

    Regards and all that,
    jkl