Just another Perl shrine | |
PerlMonks |
web scraping with javascript support?by gulden (Monk) |
on Aug 03, 2010 at 16:34 UTC ( [id://852699]=perlquestion: print w/replies, xml ) | Need Help?? |
gulden has asked for the wisdom of the Perl Monks concerning the following question: I need to scrape webpages, where parts of the HTML page is obtained through the execution of Javascript function. For instance i need to scrape the inner table of this site http://tennis.7m.cn/default_en.aspx There is a library to do this? How can I get a workaround around to do it, once I want to do this for several pages/sites? WWW::Mechanize is not the solution: «That's because WWW::Mechanize doesn't operate on the JavaScript. It only understands the HTML parts of the page.» $ wget also doesn't suppport it Any workaround/solution?
«A contentious debate is always associated with a lack of valid arguments.»
Back to
Seekers of Perl Wisdom
|
|