Hacker News new | ask | show | jobs
by NekkoDroid 390 days ago
> non-deterministic

Counterpoint: temperature = 0 /s

On a more serious note: I personally only found LLMs really interesting to double check my code if there might be something I overlooked in the general implementation (a different approach or so), never really for it to write code directly for me. I feel like this is just becoming less and less common nowadays and it kinda makes me worry for the quality of code that was already questionable at times...

1 comments

I know you used the /s but it's quite common that 0 temperature is believed to be deterministic. For others coming across this thread, it's not deterministic, it is simply less likely to return different tokens (it still absolutely will)
AFAIK it shouldn't.