in reply to Re^2: Cannot retrieve HTML for some pages with LWP
in thread Cannot retrieve HTML for some pages with LWP

Firstly, please be aware of the issues surrounding accessing Google's site in contravention of their terms of service.

It might be easier for you to use Google's own web APIs, assuming they work for Google Scholar. Look into Net::Google for examples which use ordinary Google search.

If after all you want to scrape Google Scholar, you may have some luck modifying WWW::Scraper::Google.

  • Comment on Re^3: Cannot retrieve HTML for some pages with LWP

In Section Seekers of Perl Wisdom