Hacker News new | ask | show | jobs
by remorses 748 days ago
If you set temperature to zero the output will be always the same, not a distribution. If instead you increase temperature the LLM will sometimes choose other tokens than the one with the highest score, but it won’t be that much different