Hacker News new | ask | show | jobs
by julienreszka 19 days ago
see the temperature parameter ? with current tech even if you set it to zero when you provide the same input multiple times you will rarely get the exact same output.
2 comments

The temperature parameter cannot be set to 0 via GUI, merely to a sall vale close to 0, as that would lead to a division by 0 in the code.
in proper implementation 0 means greedy decoding
yeah. because it's an LLM.

again, you are looking for an algorithm.