Post by @naught@sh.itjust.works

@naught@sh.itjust.works

2026-09-15 14:09 UTC

I wouldn’t call 48GB of VRAM a normal gaming PC, and even with that memory you’re not getting claude intelligence or performance. It’s still much more viable than ever before though. Are you running local models with limited vram with good results?

Replies (1)

@melfie@lemmy.zip 2026-09-15 14:49

I have a 7900 XTX with 24GB of VRAM where I am running Qwen 3.8 27B. I traded in my RTX 3070 and got it for around $700 recently. That model performs pretty similarly to Claude Sonnet 5 in performance for coding and certain other tasks. I was running Qwen 3.6 35B-A3B on the 3070 before and I still run it on my server with a 4060 and 32GB of RAM, and that model is more like Claude Haiku. I expect 3.8 35B-A3B should be released pretty soon and provide a nice bump in performance. I regularly follow this guy’s YouTube channel, and his latest video is about running a 177B model on his RTX 3060 via SSD offloading and getting Opus-like performance for certain tasks: m.youtube.com/watch?v=IH8XmxiwliQ. Supposedly, open weight models that run in a data center are like 4 months behind the frontier at this point, and what can run on a gaming PC is progressing rapidly as well while the exponential gains at the frontier have largely turned into incremental gains at this point.

Open ##4706003