[jayd16]

LLMs are deterministic. We just sample the results, no? Also, no reason AI needs not be deterministic.

[TeMPOraL]

> LLMs are deterministic.

In theory, yes. In practice, parallelism combined with floating point math make current implementations fundamentally non-deterministic.

[mensetmanusman]

Not fundamentally, but extremely costly to keep track of everything. Still deterministic though.

[Tycho]

Can you elaborate more on the parallelism aspect?

[joquarky]

Temperature cannot ever reach 0 (this causes a division error), so they are not deterministic.