@prettygood@socially.drinkingatmy.computer
2026-08-22 16:54 UTC
@exis7enz@clubcyberia.co @shibao@shitposter.world I don't have enough oomph local to make it worthwhile
Unless I've vastly overestimated what's required
Replies (1)
-
@exis7enz@clubcyberia.co 2026-08-23 01:21
@prettygood@socially.drinkingatmy.computer @shibao@shitposter.world 24gb VRAM is preferred, but you don't need expensive nvidia cards. my 7900 xtx cost me $900 and gets similar speed to a 3090 or 4090. for the MOE model (https://huggingface.co/unsloth/Qwen3.6-35B-A3B-GGUF) all you need is enough free system RAM, no GPU needed. the Q4 quant is just 20gb. it's a quite capable model though we're waiting for the updated version. edit: linked the wrong MOE model