[krupan]

An LLM is not a mechanical automated system. A deterministic search and replace would be a mechanical automated system. Clearly it wasn't that simple of a problem though.

[qarl]

> An LLM is not a mechanical automated system.

Pretty sure that's exactly what LLMs in coding harnesses are.

[krupan]

Still not deterministic

[qarl2]

You understand that computer programs are deterministic unless someone explicitly injects non-determinism in them, right?

Even when they implement LLMs.

[qarl2]

To the people downvoting me - I'm sorry, but it's true.

I know ChatGPT seems like it's non-deterministic - but that just a user preference.

The only real issue is if you have many people on the same server, the GPU contention can be non-deterministic in rare cases.

LLMs can be deterministic if you need them to be - it's just that most people prefer the human-like interface.