@prettygood@socially.drinkingatmy.computer @shibao@shitposter.world 24gb VRAM is preferred, but you don't need expensive nvidia cards. my 7900 xtx cost me $900 and gets similar speed to a 3090 or 4090. for the MOE model (https://huggingface.co/unsloth/Qwen3.6-35B-A3B-GGUF) all you need is enough free system RAM, no GPU needed. the Q4 quant is just 20gb. it's a quite capable model though we're waiting for the updated version. edit: linked the wrong MOE model