Re: Using Google to search perlmonks.org

Because perlmonks is not indexed by Google. This is what our robots.txt looks like:

# sorry, but misbehaved robots have ruined it for all of you.
User-agent: *
Disallow: /
[download]

Comment on Re: Using Google to search perlmonks.org Download Code

Replies are listed 'Best First'.
Re^2: Using Google to search perlmonks.org by ikegami (Patriarch) on Mar 15, 2006 at 22:25 UTC
Wouldn't misbehaved robots ignore robots.txt?	[reply]
Re^2: Using Google to search perlmonks.org by Scott7477 (Chaplain) on Mar 15, 2006 at 22:20 UTC
Thank you, ikegami and Arunbear for the info. It figures that this site has a snarky comment in its robots.txt:)...	[reply]