in reply to Using LWP instead of wget?

If you know wget's syntax better than LWP, and your target system has wget, use system() and wget. There is nothing wrong with using Perl for shell scripting. LWP has higher CPU/MEM overhead than the C wget. The core LWP (libwww-perl) doesn't support async requests. Backgrounding command line downloaders is a easy way to implement async internet requests in Perl. I personally use http://aria2.sourceforge.net/ as my command line downloader. Sometimes I run aria2 in daemon mode and control it through XML::RPC::Fast having it downloading dozens of files at the same time to disk, then I read the files synchronously into the Perl from disk for processing, its almost instantaneous because of OS write caching.

Replies are listed 'Best First'.
Re^2: Using LWP instead of wget?
by kingram (Acolyte) on Jul 28, 2012 at 05:03 UTC

    Nice!

    I'll play with that once I get my script working with wget and can update my selected podcast with automation. I really hate iTunes....