2026-02-07 14:02 UTC
@riaschissl@sigmoid.social I'd argue that you can't run infra for 20 ppl as efficiently as infra for 10 million people, resulting in even worse environmental net impact. And your small rig may be able to run inference but not training.
My main problem is that we're throwing non-deterministic "solutions" at deterministic problems in the first place.
Replies (1)
-
@riaschissl@sigmoid.social 2026-02-08 09:57
@oli@social.tchncs.de Yes, using our existing DC infrastructure may not be as efficient as once again surrendering our sovereignty to the same tech bros we regularly complain about. And I would argue that more than 90% of today's typical workload is inference rather than training. And to your last point: give any two software devs the same task and you'll get two different results. Have them do it again and you'll get another set of different solutions. Absolutely non-deterministic. No different with LLMs.