Y
Hacker News
new
|
ask
|
show
|
jobs
by
julienreszka
19 days ago
see the temperature parameter ? with current tech even if you set it to zero when you provide the same input multiple times you will rarely get the exact same output.
2 comments
jll29
19 days ago
The temperature parameter cannot be set to 0 via GUI, merely to a sall vale close to 0, as that would lead to a division by 0 in the code.
link
julienreszka
19 days ago
in proper implementation 0 means greedy decoding
link
blinkbat
19 days ago
yeah. because it's an LLM.
again, you are looking for an algorithm.
link