Hacker News new | ask | show | jobs
by TeMPOraL 756 days ago
> LLMs are deterministic.

In theory, yes. In practice, parallelism combined with floating point math make current implementations fundamentally non-deterministic.

2 comments

Not fundamentally, but extremely costly to keep track of everything. Still deterministic though.
Can you elaborate more on the parallelism aspect?