[pmarreck]

> LLMs, by their very nature are probabilistic

I believe that if you can tweak the temperature input (OpenAI recently turned it off in their API, I noticed), an input of 0 should hypothetically result in the same output, given the same input.

[bdhcuidbebe]

That only works if you decide to stick to that exact model for the rest of your life, obviously.

[oceanplexian]

The point is he said "by its nature". A transformer based LLM when called with the same inputs/seed/etc is literally the textbook definition of a deterministic system.

[sarchertech]

No one uses temperature 0 because the results are terrible.