@BastilleBSD@fosstodon.org I know they don’t respect ROBOTS.TXT but not a bad idea to throw a line about avoid X link or else be banned for life and then anyone visiting that link is clearly a bot, can be banned forever. Bait essentially. For years people would say fail2ban isn’t worth the time but having a 1 line config to ban anyone accessing non-existing links aka crawlers that don’t respect ROBOTS.TXT is definitely worth it to me.