diz
diz@awful.systems
Posts
-
View post
On the feasibility of less illegal "AI coding tools" [effortpost] So, I was thinking about how modern LLMs got better at coding in the last 1 year, despite not having much good new training data. The way it was done is largely via reinforcement learning with verifiable reward (and a little bit with human feedback). Basically, you use an LLM to make slop, random token choice and everything, monkeys on typewriters style, and then if slop passes a test, you use said slop as the train...
-
View post
So, what are the new datacenters even for? As I was using LLMs at work (I never use LLMs for personal projects), a question occurred to me: What in the fuck are these new data centers supposed to actually do? The enterprise users are all in on having LLMs write 300% of the code. And yet, both OpenAI and Anthropic are still giving these “$200 gets you $10 000 in API costs” subscriptions to every victim of AI psychosis. Why do we have RAM, hard disk, SSD, GPU and CPU shortages and no “token...
-
View post
It's fucking "AI Chornobyl" now, not just x-risk. Took a peek at what our good friends the rationalists are talking about. That’s gonna teach me not to gaze into the abyss. Apparently some AI related bigshot CEO is telling Stuart Russell that our best hope for survival is an “AI Chernobyl” which would royally piss everyone off even more. Our “leaders” are quaking in their boots and hoping a bunch of us would die so we the people take the reins and lead them somehow out of a pe...