Just a shout out to KnownAgents, for building an incredibly useful tool for blocking scrapers. Traffic at an education website I maintain has been 70:30 bots to people. https://knownagents.com/