2026-09-15 16:45 UTC
@aburka@hachyderm.io @internetarchive@mastodon.archive.org
Maybe they automated the "save page now" feature?
Because that is what I was using to periodically save updates at the forum I use. But I knew the server was limited so I would only save a few threads a day, when I had time.
But now a cloudflare checkbox blocks it all. (blocking some users too in the process.) And I am told abuse of the Internet Archive is the primary reason.
Replies (1)
-
@lxskllr@mastodon.world 2026-09-15 16:56
@5ciFiGirl@indieverse.social @aburka@hachyderm.io @internetarchive@mastodon.archive.org Dunno how it would work on a technical level, but an archive(friendly bot) scrape with a later retrieval by the (hostile bot) could disguise traffic to bypass bans. Everything's awful, and difficult to fix without manual intervention. In your case, perhaps they could make an arrangement for a specific IA bot to crawl the site at specified times, but that requires real people to deal with it, and some new procedure to allow a single bot. PITA...