[johnfn]

Is this true? Non-reasoning LLMs are autoregressive. Reasoning LLMs can emit thousands of reasoning tokens before "line 1" where they write the answer.

[computerex]

They are all autoregressive. They have just been trained to emit thinking tokens like any other tokens.

[bearjaws]

reasoning is just more tokens that come out first wrapped in <thinking></thinking>

[rimliu]

there are no reasoning LLMs.

[johnfn]

This is an interesting denial of reality.

[aqfamnzc]

A "reasoning" LLM is just an LLM that's been instructed or trained to start every response with some text wrapped in <BEGIN_REASONING></END_REASONING> or similar. The UI may show or obscure this part. Then when the model decides to give its "real" response, it has all that reasoning text in its context window, helping it generate a better answer.