in reply to Re^5: perl -Dusethreads compilation
in thread perl -Dusethreads compilation

you might think about whether multiple threads will really improve the runtime...

In case the bandwidth bottleneck in on the servers side, or the servers are responding slowly (think of sites like this one), parallelizing the downloads could certainly help.

(update: rephrased to use plural "servers" to make it clearer what I meant)

Replies are listed 'Best First'.
Re^7: perl -Dusethreads compilation
by Corion (Patriarch) on Apr 05, 2010 at 16:01 UTC

    I'm not sure I understand this. If the server is already pumping out 100% of its upstream bandwidth, how will adding more threads to hammer the server improve throughput? You might get a bigger share of the total bandwidth (and a ban), if the server allocates all connections equally.

[reply]
      ...how will adding more threads to hammer the server improve throughput?

      Sure, if all the downloads are from the same server, hammering likely won't help... The OP's description, however, left it open to interpretation whether all the download requests are actually going to the same server.

[reply]

In Section Seekers of Perl Wisdom