Beefy Boxes and Bandwidth Generously Provided by pair Networks
Clear questions and runnable code
get the best and fastest answer
 
PerlMonks  

Re: ithreads picks fight with LWP::Agent; everybody loses

by gferguson (Acolyte)
on Feb 27, 2008 at 00:04 UTC ( [id://670440]=note: print w/replies, xml ) Need Help??


in reply to ithreads picks fight with LWP::Agent; everybody loses

I did some stuff using threading, but kept getting a nervous tic when I would see the warning about threading and DBI while compiling things. I never had problems but it was such a dire message....

So, as an experiment I tried using LWP::Parallel for a project. That worked nicely and allowed me to throw 8 requests/second at my target. If I'd have had more bandwidth on the hosting machine and the network I could probably have gone higher, but 8 was the point where I saw no increase in throughput.

I never dived into the code to learn more about the why-fors on the whole threading thing. I never had problems with it, but wanted to point out there are alternatives.

  • Comment on Re: ithreads picks fight with LWP::Agent; everybody loses

Replies are listed 'Best First'.
Re^2: ithreads picks fight with LWP::Agent; everybody loses
by BlairHippo (Initiate) on Feb 27, 2008 at 07:07 UTC
    Ooh! I didn't know LWP::Parallel existed. Thanks, this could be exactly what I need!

Log In?
Username:
Password:

What's my password?
Create A New User
Domain Nodelet?
Node Status?
node history
Node Type: note [id://670440]
help
Chatterbox?
and the web crawler heard nothing...

How do I use this?Last hourOther CB clients
Other Users?
Others browsing the Monastery: (2)
As of 2024-04-26 05:13 GMT
Sections?
Information?
Find Nodes?
Leftovers?
    Voting Booth?

    No recent polls found