Re: How do I perform web automation with sites that use Javascript?

A recent addition of mine is WWW::HtmlUnit::Spidey. This module uses the Java library HtmlUnit which is a headless browser with pretty good JavaScript support. Do not worry, you won't have to write any Java code :D

It is good for massive web scraping where screen scraping does not scale and may be unstable.

There is a tutorial here that scrapes some data obtained from a form not working without JavaScript support.

Btw I am just a Perl beginner. Any Perl guru interested in co-developing Spidey?

Comment on Re: How do I perform web automation with sites that use Javascript?

Replies are listed 'Best First'.
Re: Answer: How do I perform web automation with sites that use Javascript? by Anonymous Monk on Mar 13, 2011 at 03:59 UTC
If you wish to recruit, try perl news section, much more visible	[reply]