[davekeck]

> then some lower probability tokens may be chosen

Can you explain how it chooses one of the lower-probability tokens? Is it just random?

[acchow]

Reducing temperature reduces the impact of differences between raw output values giving a higher probability to pick other tokens.

[acchow]

Oops backwards. Increasing temperature...