@dielan@shitposter.world @sun@shitposter.world @mrsaturday@shitposter.world You should be able to utilize larger models soon, with the latest techniques offloading less-critical things to system RAM or SSD, not to mention MoE architecture getting popular. People with 16 GB VRAM cards are squeezing in some big-ahh models fr fr.