2026-07-17 08:47 UTC
@bartgroothuis@mastodon.online at the same time the site that hosts the source code of Linux, is using Anubis. Anubis is a tool that is used to keep sites available for normal people when they are faced with AI crawlers that do not respect robots.txt and bring sites down due to that.
For more information:
https://anubis.techaro.lol/
https://en.wikipedia.org/wiki/Anubis_(software)
And to see for yourself:
https://git.kernel.org/
Replies (2)
-
@gytisrepecka@social.gyt.is 2026-07-17 11:57
@jschwart@mas.to Indeed - isn't that hillarious: Kernel welcomes probablistic software into codebase, but wants to keep slop machines away from it's infrastructure :blobcat_coy: @bartgroothuis@mastodon.online
-
@bartgroothuis@mastodon.online 2026-07-17 12:55
@jschwart@mas.to Interessant punt, maar dat zijn volgens mij twee verschillende dingen: Anubis stopt crawler-misbruik, niet AI-gebruik door devs. Torvalds ging het om het laatste.