in reply to Re^10: Unable to connect
in thread Unable to connect
What I'm a little concerned about is #8, "GoogleOther". What does that mean?
It's a google bot but not search-related. See https://developers.google.com/search/docs/crawling-indexing/google-common-crawlers#googleother.
Of your list of short useragents I would (and do) block all bar Googlebot, YandexBot, CCBot, SpiderLing and bingbot. Many of them are IME incredibly badly behaved.
🦛
|
---|