Elektrine lite

← Feed

@Feyd@programming.dev

2026-04-13 19:50 UTC

> You also have to run the model with the input to determine what the output will be, no way to determine it BEFORE running. With a deterministic system, if you know the code you can predict the output with 100% accuracy without ever running it. This is not the definition of determinism. You are adding qualifications. I did look it up and I see now there are other factors that aren't under your control if you're using a remote system, so I'll amend my statement to say that you *can* have deterministic inference systems, but the big ones most people use cannot be configured to be by the user.

Replies (1)

  • Deterministic systems are always predictable, even if you never ran the system. Can you determine the output of an LLM with zero temperature without ever having ran it? And even disregarding the above, no, they are still NOT deterministic systems, and can still give different results, even if unlikely. The variation is NOT absolute zero when the temperature is set to zero.

    Open ##1145113