Perl- Interacting with a web page with dynamic html (javascripts and jqueries)

vividgnome has asked for the wisdom of the Perl Monks concerning the following question:

I am working on a project wherein I have to interact with a Web page, having javascript in it, the javascript controls the login prompt, after logging , the page gets me a table of data, (which is also accomplishes using another function through the javascript) Can anyone please guide on how this can be accomplished in perl without using any browser based package (ex. Selenium, as I am trying it on a linux Server Blade, i wont have a Browser at my disposal!)

Comment on Perl- Interacting with a web page with dynamic html (javascripts and jqueries)

Replies are listed 'Best First'.
Re: Perl- Interacting with a web page with dynamic html (update: PhantomJS or WWW::WebKit) by LanX (Saint) on Nov 15, 2013 at 00:05 UTC
Unlikely! It's far easier to get a browser running on your blade, than to emulate one which fully supports JS including JQueries and DOM.š Maybe you can analyze the involved JS such that Perl can simulate the necessary HTTP communication. see also "JavaScript" in WWW::Mechanize::FAQ Cheers Rolf ( addicted to the Perl Programming Language) update š) if your only limitation is the lack of display (i.e. not having a GUI), then you probably want to try http://phantomjs.org/ or WWW::WebKit. See this blog post for more links: http://blogs.perl.org/users/robhammond/2013/02/web-scraping-with-perl-phantomjs.html	[reply]

Replies are listed 'Best First'.

Re: Perl- Interacting with a web page with dynamic html (update: PhantomJS or WWW::WebKit)
by LanX (Saint) on Nov 15, 2013 at 00:05 UTC

It's far easier to get a browser running on your blade, than to emulate one which fully supports JS including JQueries and DOM.š

Maybe you can analyze the involved JS such that Perl can simulate the necessary HTTP communication.

Cheers Rolf

( addicted to the Perl Programming Language)

update

š) if your only limitation is the lack of display (i.e. not having a GUI), then you probably want to try http://phantomjs.org/ or WWW::WebKit.

See this blog post for more links:

http://blogs.perl.org/users/robhammond/2013/02/web-scraping-with-perl-phantomjs.html

[reply]