2026-07-18 12:42 UTC
Replies (3)
-
@pawel@wspanialy.eu 2026-07-18 12:45
@scottjenson@social.coop Yeah, it's VERY slow. Like literally unusable slow. If you're trying to get off the Claude/Codex train I'd look at GLM/Kimi but it's still subscription. Really good coding agents aren't YET self hostable on "consumer" devices. And if somebody says it's not true they're either lying or have 196GB RAM Mac and are trying to say it's consumer electronic because you can buy it in the store.
-
@trademark@fosstodon.org 2026-07-18 14:10
@scottjenson@social.coop I've been reasonably happy with the 4 bits version of this one https://huggingface.co/unsloth/Qwen3.6-27B-GGUF slightly to large to fit in 16G, but the 2bits should work. I think it is around the level of a frontier model from a year ago for coding specifically, for more general stuff the big models have more breath of knowledge.
-
@trode@hachyderm.io 2026-07-18 14:41
@scottjenson@social.coop I have been testing some different models on my 128GB M1 Ultra and had some decent results. Slow for sure. Some results take 15 minutes, which would be 90 seconds on Claude Sonnet. Holding out hope that the Google+Apple models can be used for non-Xcode coding tools when they get released. Sounds like Apple is spending some effort on optimizing some for Macs specifically.