in reply to Re^2: ...How to parse search engine results fast?
in thread ...How to parse search engine results fast?

I would familiarize yourself with the robots.txt document for each site you are scraping. Google's robots.txt

Grygonos
  • Comment on Re^3: ...How to parse search engine results fast?

In Section Seekers of Perl Wisdom