Hacker News new | ask | show | jobs
by OKRainbowKid 7 days ago
So are you saying that effort level isn't a parameter to an LLM, but that each level actually corresponds to a slightly differently tuned LLM?
1 comments

I think the analogy here is time. Especifically performance time. Head chef performs slower. High effort is longer inference time. For LLMs, the ability to think in more detail requires more time. Maybe this will change in the future but it is the present now.