in reply to Re^2: Combining LWP::Parallel::UserAgent with WWW::Mechanize
in thread Combining LWP::Parallel::UserAgent with WWW::Mechanize

I don't use threads, but I do know that the memory consumption tends to be higher with threads than with an equivalent number of processes. I use Parallel::ForkManager, and it works well and reliably. Collecting the data can be more work than with threads though.
  • Comment on Re^3: Combining LWP::Parallel::UserAgent with WWW::Mechanize