[coldtea]

>Probably not you, but on this very forum there are plenty who will argue that LLMs / AI are entirely deterministic and that given enough time, a chisel, and sufficient clay tablets, any AI output can be calculated by hand.

Any particular AI output is deterministic (and can be calculated by hand even, if you're immortal).

But it's not deterministic in the sense that (a) it's a black box on the Cloud, (b) repeated AI prompts don't give the same results.

[nandomrumber]

Isn’t your (b) only because of the addition of a random seed?

[aesthesia]

LLM inference can be implemented in a way where nondeterminism depends only on the random seed, but that's not common. It ends up being more efficient/easier to implement kernels whose exact results depend on how many other prompts are being processed in parallel. See https://thinkingmachines.ai/blog/defeating-nondeterminism-in... for a pretty extensive exploration.

[andrewaylett]

That's still nondeterminism as an implementation choice, rather than as a fundamental limitation of the technology.