Y
Hacker News
new
|
ask
|
show
|
jobs
by
blinkbat
19 days ago
you mean... an algorithm? what is a "deterministic LLM"?
1 comments
julienreszka
19 days ago
see the temperature parameter ? with current tech even if you set it to zero when you provide the same input multiple times you will rarely get the exact same output.
link
jll29
19 days ago
The temperature parameter cannot be set to 0 via GUI, merely to a sall vale close to 0, as that would lead to a division by 0 in the code.
link
julienreszka
19 days ago
in proper implementation 0 means greedy decoding
link
blinkbat
19 days ago
yeah. because it's an LLM.
again, you are looking for an algorithm.
link