2026-07-18 14:10 UTC
@scottjenson@social.coop I've been reasonably happy with the 4 bits version of this one https://huggingface.co/unsloth/Qwen3.6-27B-GGUF slightly to large to fit in 16G, but the 2bits should work. I think it is around the level of a frontier model from a year ago for coding specifically, for more general stuff the big models have more breath of knowledge.
Replies (0)
No replies.