in reply to Using Google to search perlmonks.org

We had thepen and it was a much better place for google to index and so it was a good thing for google to not index PerlMonks directly (it got confused because (www.)?perlmonks.(org|com|net) are all the same site and so would index each page as many as 6 separate ways, it would preserve random, old chunks of ChatterBox conversation for longer than many felt comfortable with, etc.). But thepen silently went away not too long ago.

In the mean time, work was done on making a robot-friendly face for PerlMonks so that we could have google (et al) index us directly, but that work is not finished, unfortunately.

So we are left with no google index. I hope that will be resolved soon, but these things always take longer than most would think they'd be likely to.

- tye        

  • Comment on Re: Using Google to search perlmonks.org (changes)

Replies are listed 'Best First'.
Re^2: Using Google to search perlmonks.org (changes)
by Scott7477 (Chaplain) on Mar 16, 2006 at 03:52 UTC
    Your comments make sense. I am not unhappy that the site blocks search engines. I haven't spent a lot of time yet mastering Super Search, so I know I could have found more posts by using that more expertly.

    Obviously, it makes sense that having a search engine friendly site will increase the exposure of this site specifically and Perl generally. So it would be good to have this project done, as you say.

    I totally agree with the desire to avoid the problems with search engines that you mention. Obviously, folks use the Chatterbox with the expectation that they can chat freely without having their conversations recorded.

    Thanks to you and the rest of the site maintainers for your efforts.

    Scott
      I haven't spent a lot of time yet mastering Super Search, so I know I could have found more posts by using that more expertly.

      Note that Super Search sucks at what google is best at while Super Search is good at things google sucks at and can do things google refuses to do (and vice versa). So the two complement each other (and google is probably easier to like for searching here, as Super Search takes a bit of care to use effectively).

      So we want google searching of PerlMonks as an alternative to Super Search and for the reasons you cited. (:

      - tye        

      I am a bit embarrassed to admit that I only recently stumbled across Using the Simple Search. In any case, it looks like SiteDocClan has some work to do there in light of comments made earlier in this thread... ;-)

      planetscape realizes she is tempting the gods with these comments... ;-)

      HTH,

      planetscape