in reply to Re: Speeding things up -- LWP::Parallel
in thread Speeding things up

Hi Discipulus,

... while i invite you to take a look to MCE unfortunately is not usefeul in this case because LWP::* modules are not thread safe ...

An event-type module is typically preferred for this use-case. However, I took a look and tracked this down. See Re: Crash with ForkManager on Windows. When running parallel using LWP::*, it is essential to load IO::Handle and a couple Net::* modules before spawning workers. The latest MCE and MCE::Shared (MCE::Hobo) updates do this automatically if present, LWP::UserAgent.

use LWP::Simple; # Pre-load essential modules for extra stability. if ( $INC{'LWP/UserAgent.pm'} && !$INC{'Net/HTTP.pm'} ) { require IO::Handle; require Net::HTTP; require Net::HTTPS; }

Regards, Mario