in reply to Testing a web crawler

You could bundle a real web server with your code. 53k, configured via the command line and legally unrestricted.


Examine what is said, not who speaks -- Silence betokens consent -- Love the truth but pardon error.
"Science is about questioning the status quo. Questioning authority".
In the absence of evidence, opinion is indistinguishable from prejudice.
"I'd rather go naked than blow up my ass"