Hacker News new | ask | show | jobs
by Majromax 155 days ago
If you remove the conditional and keep the same math, you divide by zero and get nans. In the limit as temperature goes to zero, you do in fact get maximum likelihood sampling.
1 comments

if (t==0) argmax(logits) else pick(logits)
You are ignoring the limit taking.
If t < 0.1 return {error, 400}
Do you know that a mathematical limit is?