Hacker News new | ask | show | jobs
by 2ndorderthought 39 days ago
I'm not so sold the LLM is an LLM without a sampler but it's not worth quibbling over. It's part of the statistical model anyways.
1 comments

the llm is the trained part, the rest is the handwritten part. The sampler is handwritten, not learned.
Believe it or not in statistics and machine learning the hard coded parts of a model that impact the results are considered part of the model. But I understand that now days we don't care about these things because ai goes brrr.