Elektrine lite

← Feed

@ben@mastodon.bentasker.co.uk

2026-03-12 20:07 UTC

New #Documentation: Blocking requests from #Cloudflare's automated browser #crawl endpoint Cloudflare recently announced an endpoint on their Browser Rendering service which allows users to make one API request to trigger a crawl of an entire site. This documentation details how to block the resulting request. https://www.bentasker.co.uk/posts/documentation/general/blocking-cloudflares-automated-crawl-endpoint.html

Replies (0)

No replies.