(LLMs aren’t markovian; they need the whole history, or at least their whole context. Said context is quite large, certainly more than most people can usefully remember. Part of what makes them so good at literature search.)