2026-10-07 01:32 UTC
Okay look, the harness question is a whole nother one. I just want to know, if you consider the model + kv cache together, does that match your definition? The KV cache can change and the model’s internal state and outputs can change in response to it.
Replies (1)
-
@midribbon_action@lemmy.blahaj.zone 2026-10-07 01:46
KV caching doesn’t persist between prompts, it is an internal optimization used while generating text. I don’t see how it’s relevant. Edit: it kinda sounds like you’re technobabbling me, like “but it uses a recursive algorithm, it must be alive, check mate!” Your question is a non sequitur.