@jon@social.vivaldi.net The "defense" needed is an nginx bucket. Sure, it was nice running a site that never got slashdotted but let's not pretend that it's somehow difficult to handle the rather tiny crawler traffic. https://blog.troed.se/posts/nginx-meta-rate-limiting/