Retrieving data from web where Javascript is included

Anonymous Monk has asked for the wisdom of the Perl Monks concerning the following question:

Hi,

I have to get the data from one url where it is using a javascript function to populate the data.

I use this for normal pages.

$req = $ua->request( $form->click() );
[download]

In web page <td width='10%'><input type='submit' value='Go' onclick='RunAllShip();'></td>

So I need to call RunAllShip() function which also included in html source.

Please help me in this.

20080618 Janitored by Corion: Added formatting, code tags, as per Writeup Formatting Tips

Comment on Retrieving data from web where Javascript is included Select or Download Code

Replies are listed 'Best First'.
Re: Retrieving data from web where Javascript is included by marto (Cardinal) on Jun 18, 2008 at 12:19 UTC
First of all please read How do I post a question effectively? and Writeup Formatting Tips. Secondly this questions gets asked every so often (did you Super Search before posting?), LWP and WWW::Mechanize do not support JavaScript. You can either reverse engineer the JavaScript within you Perl code (where possible) or use Win32::IE::Mechanize or Mozilla::Mechanize. Martin	[reply]
Re^2: Retrieving data from web where Javascript is included by Anonymous Monk on Jun 19, 2008 at 09:04 UTC
Thanks for the response. Right now I am using perl v5.6.1. It is asking for v5.8.0 can you suggest me in this?	[reply]
Re^3: Retrieving data from web where Javascript is included by marto (Cardinal) on Jun 19, 2008 at 09:21 UTC
Did you read my previous post, I mentioned reading How do I post a question effectively?. With that in mind you say, "It is asking for v5.8.0", what is "It"? Also Perl 5.6.1 is pretty old, have you considered installing a modern version of perl (perhaps to a different path, as the 5.6.1 version may be being used by your OS).? Martin	[reply]
Re: Retrieving data from web where Javascript is included by psini (Deacon) on Jun 18, 2008 at 12:20 UTC
In general the best method is to understand what the js call do and mimic its behavior. Careful with that hash Eugene.	[reply]