in reply to what modules you recommend for downloading hundreds of URLs per second in parallel?

Try Gungho. Or you could invoke an external crawler like Httrack (written in C, very fast).
  • Comment on Re: what modules you recommend for downloading hundreds of URLs per second in parallel?