crawl a full webpage one time

liuweichuan has asked for the wisdom of the Perl Monks concerning the following question:

using Perl, how to get a full web page (include ajax web) once like phantomjs ? And what kind of brower useragent can do this?

Comment on crawl a full webpage one time

Replies are listed 'Best First'.
Re: crawl a full webpage one time by Corion (Patriarch) on Oct 21, 2016 at 08:06 UTC
Have you searched the CPAN for PhantomJS? Also see how to get active web page by Perl where you already were pointed towards WWW::Mechanize::Firefox.	[reply]
Re: crawl a full webpage one time by Discipulus (Canon) on Oct 21, 2016 at 08:06 UTC
The State of Web spidering in Perl L* There are no rules, there are no thumbs.. Reinvent the wheel, then learn The Wheel; may be one day you reinvent one of THE WHEELS.	[reply] [d/l]