2026-10-09 23:43 UTC
@dielan@shitposter.world @mrsaturday@shitposter.world I'm gonna try to get hermes working with a local model again today, perhaps qwen3.8 flash
Replies (1)
-
@dielan@shitposter.world 2026-10-09 23:44
@sun@shitposter.world @mrsaturday@shitposter.world if I knew this AI stuff was coming like this in 2024 i would have gotten a slightly better card. I'm stuck at 20 GB VRAM with my 7900XT. So i can run 27B models with like no context window, or i can run smaller models one might recommend for a 16GB card with a big dick context window. It's not a bad life but damn i wish i had 24GB VRAM