Processing websites in Perl

pdaalder has asked for the wisdom of the Perl Monks concerning the following question:

Hi I'm trying to find out if there are modules that I can use to read a website, set values, and submit the page. Also I want to retrieve the results, so the page (or subpage). Any suggestions? It is to make my daily life simpler and less frustrated. Cheers

Comment on Processing websites in Perl

Replies are listed 'Best First'.
Re: Processing websites in Perl by Errto (Vicar) on May 24, 2005 at 03:57 UTC
I haven't used it, but a quick peek around PerlMonks suggests that WWW::Mechanize is a popular choice. If you wish to work with HTTP calls at a somewhat lower level, I've used LWP::UserAgent to great success.	[reply]
Re: Processing websites in Perl by johnnywang (Priest) on May 24, 2005 at 04:06 UTC
Yes, as Errto pointed out, WWW::Mechanize is probably the most useful one, it uses LWP::UserAgent, and provides enough methods to make things much easier. If you need to deal with javascript, Win32::IE::Mechanize is also useful. If you just need to get some pages, LWP::Simple is the, simplest.	[reply]
Re: Processing websites in Perl by kprasanna_79 (Hermit) on May 24, 2005 at 04:01 UTC
Hai pdaalder, If my understanding is correct, u can use WWW::Mechanize. U can also see this monks view --prasanna.k	[reply]
Re^2: Processing websites in Perl by pdaalder (Initiate) on May 24, 2005 at 04:12 UTC
thnx for the help, this is what I'm looking for. Would like to build a command line website handler (for a specific site, at my work).	[reply]