I'd *really* reccomend LWP::Parallel::UserAgent - as well as retrieving in parallel its easy to set a timeout, deal with redirects, claim to be using such and such browser etc. Check the doc for skeleton code for the problem you describe.
Ntav.
NAPH