in reply to Re: Searching the monastery with duckduckgo leads to ugly results
in thread Searching the monastery with duckduckgo leads to ugly results

OK I provided a patch to the "bare general container" and added a noindex meta-tag in the head. °

After application, this should be effective within days. If successful this could be extended to other page paths like mobile/ and displaytypes like print

The gods are still free to adjust the main robots.txt then, to additionally reduce the load by spiders. :)

Cheers Rolf
(addicted to the Perl Programming Language :)
Wikisyntax for the Monastery

°) applied 2021-11-02

Replies are listed 'Best First'.
Re^3: Searching the monastery with duckduckgo leads to ugly results (patch)
by LanX (Saint) on Jan 06, 2022 at 13:40 UTC
    > noindex meta-tag in the head

    unfortunately this didn't have the expected outcome.

    bare is still shown in the search results, only these pages are not cached by the search engines anymore.

    We need to adjust the robots.txt, and this can only be done by a god.

    Cheers Rolf
    (addicted to the Perl Programming Language :)
    Wikisyntax for the Monastery

Re^3: Searching the monastery with duckduckgo leads to ugly results (Bing)
by LanX (Saint) on Nov 03, 2021 at 12:04 UTC
    according to DDG's website they are getting most of their results from Bing, which in turn is respecting noindex and robots.txt

    Search results look indeed similar (lot's of bare ATM)

    -> https://www.bing.com/search?q=schwartzian+transform+perlmonks

    So solving the problem for Bing should solve it for DDG too.

    The top result was cashed by bing in 2021-10-05, so updating may take a while.

    Cheers Rolf
    (addicted to the Perl Programming Language :)
    Wikisyntax for the Monastery