@fj@mastodon.social ah, the ancient art of scraping websites which completely ignore all standards and best practices... my favorites are public administration portals: robots.txt bans everybody but Google and Facebook, no site map, no HTML5 semantic elements but just endless nested divs, dynamic content generated with custom JS for no reason, and obscure JS session tokens in every URL... Oh, and 5 seconds load times