Re^2: how to get dynamic html pages??

for example http://beta.nasdaq.com/ page got thru LWP::Useragent doesn ve all the data that u can see on screen.. think it uses lotta dynamic data.. i guess completely emulating a browser (like firefox) in executing the page may help.. can u pl propose some ways for that..

Comment on Re^2: how to get dynamic html pages??

Replies are listed 'Best First'.
Re^3: how to get dynamic html pages?? by blue_cowdawg (Monsignor) on Jan 25, 2008 at 13:42 UTC
can u pl propose some ways for that.. Conceptually what you need to do is parse the HTML you have read in on a page, look for URIs pointing to other resources, fetch those, act on those, lather, scrub , rinse, repeat as necessary.... Peter L. Berghold -- Unix Professional Peter -at- Berghold -dot- Net; AOL IM redcowdawg Yahoo IM: blue_cowdawg	[reply]