Hacker News new | ask | show | jobs
by _delirium 479 days ago
The probability of token generation is a function of the logits. Do you have an actual point related to the linked paper?
1 comments

That is one way of sampling tokens. It is not the only way. Logits do not map neatly to belief, although it is convenient to behave as if they do