Hacker News new | ask | show | jobs
by 000ooo000 388 days ago
>LLM’s are inherently non-deterministic.

I'm not an ML guy but I was curious about this recently. There is some parameter that can be tuned to produce determinism but currently it also produces worse results. Big [citation needed], but worth a google if it's of interest. Otherwise in agreement with your post.
1 comments
agarren 388 days ago
Temperature? Definitely tweaks the results…but I don’t know if “deterministic” is a term you can use in any way, shape, or form, in the context of LLMs.

https://www.ibm.com/think/topics/llm-temperature

link
Ancapistani 388 days ago
Unless I’ve misunderstood something, setting a constant seed and a temperature of zero would give deterministic results.

Not good results necessarily, but consistent.

link