you seem to have not read my node. I stated that the goal was to quickly check a list of urls for 4xx/5xx errors. Not to completely spider a site, not to check one at a time, not to examine all links on a page for validity, and definately not to frequently monitor and report on availability. If you're going to negatively comment, then comment on topic, like my algorithm sucks or there's a better way to check that would take less than a minute to code. My point was that I wrote this in less time than it would take to download, untar linklint, see the instructions and get on to using it.