Further Update: we're being done in by an AI. More specifically, ClaudeBot has been aggressively scraping Stardot, pretty much overloading our little corner of the web, in the name of LLM 'AI'. I didn't see this until BigEd reminded me over on Discord. We do periodically blacklist certain bots (we have to allow others so the 'good' search engines can see us) but this one has been so persistent, I've ended up blocking it completely rather than just using robots.txt to discourage it. That by itself has improved things a little, but I'm still seeing a lot of child processes on the server. Shortly after I post this message I'll restart the server and MySQL processes and see how that goes.
Statistics: Posted by baz4096 — Tue May 21, 2024 10:57 pm