Here is a quick Benchmark:
#!/usr/bin/perl -w
use strict;
use Benchmark qw(:all);
use WWW::Curl::Lite::Request;
use WWW::Curl::Lite;
use LWP::UserAgent;
use LWP::Parallel::UserAgent;
use HTTP::Request;

my $request = new WWW::Curl::Lite::Request( { url => 'http://127.0.0.1
+' } );
my $curl    = new WWW::Curl::Lite;

my $ua = new LWP::UserAgent;

my $pua     = new LWP::Parallel::UserAgent;
my $httpreq = new HTTP::Request( GET => 'http://127.0.0.1' );

timethese(
    100,
    {
        'curl' => sub {
            for ( 1 .. 10 ) { $curl->register($request) }
            $curl->request;
        },
        'lwp' => sub {
            for ( 1 .. 10 ) { $ua->get('http://127.0.0.1') }
        },
        'lwp-parallel' => sub {
            $pua->initialize;
            $pua->nonblock(1);
            for ( 1 .. 10 ) { $pua->register($httpreq) }
            $pua->wait;
          }
    }
);

[download]
sri@odyssey:~$ perl benchmark2.pl
Benchmark: timing 100 iterations of curl, lwp, lwp-parallel...
      curl: 25 wallclock secs ( 1.07 usr +  0.18 sys =  1.25 CPU) @ 80
+.00/s (n=100)
       lwp: 30 wallclock secs ( 7.12 usr +  0.51 sys =  7.63 CPU) @ 13
+.11/s (n=100)
lwp-parallel: 34 wallclock secs (11.07 usr +  0.56 sys = 11.63 CPU) @ 
+ 8.60/s (n=100)

[download]
Most suprising is how bad LWP::Parallel performed.

Yes, it wasn't 30 times faster in this benchmark, the original one was performed on a small crawler cluster with 10000 real world url's, maybe i can reformat these results and post them too.

In reply to Re: Re: First impressions of WWW::Curl::Lite by sri
in thread First impressions of WWW::Curl::Lite by sri

Title:
Use:  <p> text here (a paragraph) </p>
and:  <code> code here </code>
to format your post, it's "PerlMonks-approved HTML":


  • Posts are HTML formatted. Put <p> </p> tags around your paragraphs. Put <code> </code> tags around your code and data!
  • Titles consisting of a single word are discouraged, and in most cases are disallowed outright.
  • Read Where should I post X? if you're not absolutely sure you're posting in the right place.
  • Please read these before you post! —
  • Posts may use any of the Perl Monks Approved HTML tags:
    a, abbr, b, big, blockquote, br, caption, center, col, colgroup, dd, del, details, div, dl, dt, em, font, h1, h2, h3, h4, h5, h6, hr, i, ins, li, ol, p, pre, readmore, small, span, spoiler, strike, strong, sub, summary, sup, table, tbody, td, tfoot, th, thead, tr, tt, u, ul, wbr
  • You may need to use entities for some characters, as follows. (Exception: Within code tags, you can put the characters literally.)
            For:     Use:
    & &amp;
    < &lt;
    > &gt;
    [ &#91;
    ] &#93;
  • Link using PerlMonks shortcuts! What shortcuts can I use for linking?
  • See Writeup Formatting Tips and other pages linked from there for more info.