Re: Perlmonks.com and Perlmonks.net now redirect to Perlmonks.org
by roho (Bishop) on May 18, 2026 at 02:15 UTC
|
"Well done" to everyone involved in counteracting the bots and restoring Perlmonk's responsiveness. Your hard work is appreciated.
"It's not how hard you work, it's how much you get done."
| [reply] |
Re: Perlmonks.com and Perlmonks.net now redirect to Perlmonks.org
by syphilis (Archbishop) on May 15, 2026 at 03:09 UTC
|
If you notice any adverse changes, please post a reply here.
When attempting to access a node, I intermittently get:
Error 503 Backend unavailable, connection timeout
Backend unavailable, connection timeout
Error 54113
Details: cache-wsi-ysbk1060063-WSI 1778814214 2084897532
Varnish cache server
Cheers, Rob | [reply] [d/l] |
|
|
These errors come when the backend is overloaded.
This problem still happens, since now the TCP ports are not exhausted anymore, but the bots are still hitting the site a lot and the caching on Fastlys side is not yet there/set up well enough to give these bots a good answer. We reject them more quickly and now hit 40 requests/s easily, but that does not mean that logged-in users always get a connection to the backend unfortunately.
| [reply] |
|
|
| [reply] |
|
|
Yes, I'm also seeing the same error quite a lot. For example:
Error 503 Backend unavailable, connection timeout
Backend unavailable, connection timeout
Error 54113
Details: cache-mel11252-MEL 1778815557 3830543164
Varnish cache server
Update: got this similar one when voting on a node:
Error 503 Resource temporarily unavailable
Resource temporarily unavailable
Error 54113
Details: cache-mel11279-MEL 1778820406 2833676408
Varnish cache server
Update: another similar one:
Error 503 first byte timeout
first byte timeout
Error 54113
Details: cache-mel11226-MEL 1778826805 3169835228
Varnish cache server
Further update : Yesterday (May 15) was terrible, lots and lots of timeouts.
Today (May 16) has been much better, no problems at all.
| [reply] [d/l] [select] |
|
|
I am seeing the same error message.
Error 503 Resource temporarily unavailable
Resource temporarily unavailable
Error 54113
Details: cache-pdk-kpdk2140043-PDK 1778819728 1898921539
Varnish cache server
"It's not how hard you work, it's how much you get done."
| [reply] [d/l] |
Re: Perlmonks.com and Perlmonks.net now redirect to Perlmonks.org
by Corion (Patriarch) on May 16, 2026 at 06:55 UTC
|
Currently accessing the site is (again) hard, because logged-in traffic does not have priority over anonymous traffic. We are looking at ways to tweak the setup so that logged-in users get access to the site.
| [reply] |
|
|
| [reply] |
|
|
I haven't done anything, but I suspect that either Leo or Olaf hit a config that priorizes logged-in users over anonymous connections.
Personally, I'm still reading up on Varnish Configuration Language, but I have a good draft of what I want to use to block more bots at the edge.
At least the part that I hoped that Fastly would fix seems to work. We don't exhaust TCP connections on the Pair machine anymore, and Fastly handles all of that.
| [reply] |
|
|
Re: Perlmonks.com and Perlmonks.net now redirect to Perlmonks.org
by Anonymous Monk on May 19, 2026 at 07:36 UTC
|
| [reply] |
|
|
Yes. For Anonymous Monk, all pages are cached for 1 day. This is the easy solution while we look at differentiating anonymous human access from anonymous scrapers.
When the dust has settled, I'll be looking at the Fastly API to see how we can invalidate the cache or supply a different result to the cache for the affected nodes in that conversation.
| [reply] |
Re: Perlmonks.com and Perlmonks.net now redirect to Perlmonks.org
by hippo (Archbishop) on May 19, 2026 at 08:02 UTC
|
Just in case it has not been noticed - this change appears to have locked out the chatterbot. last hour of cb has been empty since the switch-over.
| [reply] |
|
|
Yes, that's mildly expected - it also affects mini-cb60 for example. The reason is that we currently serve cached content to all anonymous GET requests.
The solution I see for this is to explicitly allow requests with the libwww-perl/x.y User Agent, or create a special URL that is not cached.
| [reply] [d/l] [select] |
|
|
Tempting though it is, I would not go making special exceptions for widely-used user agent strings like this. You'll be back to square one in no time.
The other option sounds good. I don't know what the chatterbot hits to get the messages but I see no value at all in serving say FullPage Chat with a long cache time. Still cache it to avoid catastrophe but drop the cache duration down to 30 seconds or so. Hopefully that will go some way to solving it.
| [reply] |
|
|