Where is the Mozilla::Mechanize

zli034 has asked for the wisdom of the Perl Monks concerning the following question:

Scrap a web page, get round with javascript. Where is the Mozilla::Mechanize or win32::IE::mechanize, which compiled ready to install ppm repository? As far as I know, www::mechanize doesn't work with javascript. However, the ppm repositories I know, all don't provide win32::IE::Mechanize or Mozilla::Mechanize, which probably can do the work.

Comment on Where is the Mozilla::Mechanize

Replies are listed 'Best First'.
Re: Where is the Mozilla::Mechanize by perrin (Chancellor) on Sep 02, 2007 at 03:32 UTC
You don't need to execute JavaScript just to do web scraping. Read the page and do whatever the JavaScript would do. It is not possible for JavaScript to send a message to the server that you can't duplicate with WWW::Mechanize.	[reply]
Re: Where is the Mozilla::Mechanize by adrianh (Chancellor) on Sep 02, 2007 at 17:10 UTC
Take a look at Selenium (perl drivers via WWW::Selenium and friends) that can be used to drive various browsers directly.	[reply]