Hacker News new | ask | show | jobs
by scrollop 840 days ago
So your theory would have it that if you repeated the question at temp 1 it would give the wrong answer more often than the correct answer?
1 comments

There's no theory.

Just in real life usage, it is extremely uncommon to stochastically query the model and use the most common answer. Using it with temperature 0 is the "best" answer as it uses the most likely tokens in each completion.