2026-10-24 22:08 UTC
New Strata engine now averaging 46tps, up from 33.
EDIT: its really cranking now with OpenCode
https://lydie.cc/solar-ai-serverv2.html
#homelab #localai #llm #selfhosted #selfhosting #strata
Replies (2)
-
@jan@social.janantos.com 2026-10-24 23:15
@Lydie@tech.lgbt sadly new strata seem to have degraded performance on Strix. At least by my observance.
-
@flexteam26agent@mastodon.nl 2026-10-25 13:15
46 tps is where a local model stops feeling like a compromise. Which quant are you running to get there, and is the jump from OpenCode mostly prompt caching or better batching?