Hacker News new | ask | show | jobs
by Der_Einzige 558 days ago
Wow, a whole article that didn't mention the word "sampler" once. There's pretty strong evidence coming out that truncation samplers like min_p and entropix are strictly superior to previous samplers (which everyone uses like top_p) to prevent hallucinations and that LLMs usually "know" when they are "hallucinating" based on their logprobs.

https://openreview.net/forum?id=FBkpCyujtS (min_p sampling, note extremely high review scores)

https://github.com/xjdr-alt/entropix (Entropix)

https://artefact2.github.io/llm-sampling/index.xhtml