Download web data

pmuskie has asked for the wisdom of the Perl Monks concerning the following question:

I just want to download some stock data (i.e. High, Low, Price ) from this site:

http://money18.on.cc/eng/info/liveinfo_quote.html?symbol=1

The problem is these data are generated by javascript. When I just use the above link to download into a file, I just can't see those figures in there. (even view source from Firefox can't see them).

Could anyone give me some hint how to get it done?

Thanks!

Comment on Download web data

Replies are listed 'Best First'.
Re: Download web data by roboticus (Chancellor) on Oct 15, 2010 at 12:17 UTC
pmuskie: Read the javascript and emulate what the script does, or use WWW::Mechanize::Firefox (or similar) to make a browser do the work for you. ...roboticus	[reply]
Re^2: Download web data by Anonymous Monk on Oct 15, 2010 at 15:52 UTC
roboticus, Thanks for the prompt reply! Do you have more info for the first opton? cheers!	[reply]
Re^3: Download web data by Corion (Patriarch) on Oct 15, 2010 at 16:54 UTC
Reading is something you have to do with your eyes. Emulating is something you have to do with your brain.	[reply]
Re^3: Download web data by pemungkah (Priest) on Oct 15, 2010 at 21:50 UTC
The Firefox Live HTTP Headers extension is invaluable for this kind of thing. You can watch the requests and responses go by and then write LWP or WWW::Mechanize code to duplicate the sequence. There are recording proxies that are supposed to do this automatically but I've never had much successs in getting them to work.	[reply]