How to Scrapping Google Insights

lztoby has asked for the wisdom of the Perl Monks concerning the following question:

Hi, I want to extract the category information returned by Google Insights when you search a certain keyword. For example, when I search "Apple", there return would be like:

Web Search Interest: apple

Worldwide, 2004 - present

Categories: Computers & Electronics (25-50%), Entertainment (0-10%), Food & Drink (0-10%)

And the fields behind "Categoires" are the strings that I want to scrap from Google Insights. I have tried to parse the returned HTML by sending request to Insights,but it seems Google used AJAX and every HTML returned are the same default one. Is there any other ways to solve this problem? Thanks very much.

Comment on How to Scrapping Google Insights

Replies are listed 'Best First'.
Re: How to Scrapping Google Insights by Anonymous Monk on Feb 19, 2010 at 05:24 UTC
You want to read terms of service, get a google account, read api ...	[reply]
Re: How to Scrapping Google Insights by scorpio17 (Canon) on Feb 19, 2010 at 15:12 UTC
As a general rule, if a company like Google makes something hard to do, it's because they don't want you doing it! And if you DO figure out a way to do it, all they have to do is make one little change and all your stuff breaks. Most of the info they're willing to share is available via published APIs. You just have to do a little digging to find them all. Try starting here: http://code.google.com/intl/en/	[reply]
Re^2: How to Scrapping Google Insights by lztoby (Initiate) on Feb 20, 2010 at 01:18 UTC
I have checked and seems there is no API for Insights.	[reply]