Hi

I'm still hoping/waiting for input from someone experienced.

From what I've read so far:

On www.perlmonks.org (the main target)

• disallow /bare/
• disallow /mobile/

On qs\d+.pair.com domains

• disallow /

Or

• disallow /~perl2/

(Update: Same for vps\d+.pairvpn.com/~monkads/? and other mirror domains (???)

In the templates for displaytype=print etc

• Add a meta tag for robots disallow

I guess that should do it

AFAICS are there also possibilities for settings in .htaccess for non-html file-types.

YMMV

Update

If say the settings should be for all user agents.

I suppose Google is using some helpful heuristics already.