[Der_Einzige]

Zero discussion around LLM sampling. How do you leave such a gaping hole in such a written piece? I know it's not AI cus AI wouldn't be that sloppy.

[ttkciar]

Local inference users are all about sampling, but users addicted to commercial inference services are wary of sampling, because they have to pay by the token.