Many sites refuse HEAD requests for no better reason than that they've seen it done that way or inherited it in a canned .htaccess file. Your only recourse is to record which sites don't respond and GET for just those.