Hacker News new | ask | show | jobs
by blinkbat 19 days ago
you mean... an algorithm? what is a "deterministic LLM"?
1 comments

see the temperature parameter ? with current tech even if you set it to zero when you provide the same input multiple times you will rarely get the exact same output.
The temperature parameter cannot be set to 0 via GUI, merely to a sall vale close to 0, as that would lead to a division by 0 in the code.
in proper implementation 0 means greedy decoding
yeah. because it's an LLM.

again, you are looking for an algorithm.