in reply to Fast fetching of HTML response code
Yes, its called a linkchecker, several already exist, see http://linkchecker.sourceforge.net/, http://validator.w3.org/checklink, use head, even fake head request