Perl script to download web content

quipper has asked for the wisdom of the Perl Monks concerning the following question:

Task : To download content from web and store in directory

Usage : script  URL  destination_directory

Example : perl script  "http://www.perl.org/i/camel_head.png"  /tmp
[download]

This should save the camel_head.png file into /tmpdirectory.

Appreciate help from the monks

Thanks

Kunal

Comment on Perl script to download web content Download Code

Replies are listed 'Best First'.
Re: Perl script to download web content by marto (Cardinal) on Nov 12, 2010 at 12:21 UTC
LWP ships with a script lwp-download which does exactly this.	[reply]
Re: Perl script to download web content by bart (Canon) on Nov 12, 2010 at 12:34 UTC
I assume that this is a homework problem, and that it's not the intention to just use an existing script, even if it comes straight from CPAN. In that case, you can still make use of a module, because that's what you ought to do when doing this for a real script, so I suggest you take a good looks at LWP::Simple, in particular the subs `get` and `getstore`.	[reply] [d/l] [select]
Re: Perl script to download web content by AR (Friar) on Nov 12, 2010 at 14:15 UTC
Can you use wget?	[reply]
Re^2: Perl script to download web content by quipper (Initiate) on Nov 12, 2010 at 16:23 UTC
Dear Monks , Thanks for your response Marto - using lwp-download fixes my problem Bart - Yes this is a homework problem , i can now use it in my script	[reply]
Re^3: Perl script to download web content by marto (Cardinal) on Nov 12, 2010 at 19:25 UTC
If you're simply going to submit the script as your own work, you've missed the point of your homework.	[reply]
Re^4: Perl script to download web content by quipper (Initiate) on Nov 13, 2010 at 08:37 UTC
Re: Perl script to download web content by pemungkah (Priest) on Nov 16, 2010 at 02:53 UTC
Hi, quipper - regardless of whether `lwp-download` as a component is acceptable, I'd like to suggest that you look through it (and maybe even through LWP) as a learning experience. If you later chance across a similar problem that `lwp-download` won't cut it for (say, logging in to a password-protected website that needs a cookie for access), knowing what the basic operations are might be really helpful. I'd personally have used WWW::Mechanize and written it as a one-liner - just about as short as using `lwp-download` but easier to adapt if necessary.	[reply]