Thanks for the link & advice, Randal. I've got a database of around 200 URLs, say I checked 10 at a time using LWP::parallel it shouldn't hurt the server too much, shoult it?
It's a preety high-spec dedicated machine. What would anyone say would be the limit to these parallel connections?