in reply to Question: Fast way to validate 600K websites
Wow! 6OOK ... this is going to saturate someone's bandwidth. By validate, I'm assuming you just want to ensure the urls are still active. There's a lot of reasons why a url that doesn't resolve right now may resolve 5 minutes from now so there's no real way to do this 100% (but hey, that's the nature of TCP/IP). One way to do it is to look at Parallel::ForkManager - it actually uses this scenario in it's documentation (although, you may want to just do a get instead of a getstore).
|
|---|