[criddell]

If you graded humanity on their reasoning ability, I wonder where these models would score?

I think once they get to about the 85th percentile, we could upgrade the phrase to advanced reasoning. I'm roughly equating it with the percentage of the US population with at least a master's degree.

[chairhairair]

All current LLMs openly make simple mistakes that are completely incompatible with true "reasoning" (in the sense any human would have used that term years ago).

I feel like I'm taking crazy pills sometimes.

[int_19h]

If you showed the raw output of, say, QwQ-32 to any engineer from 10 years ago, I suspect they would be astonished to hear that this doesn't count as "true reasoning".

[simonw]

Genuine question: what does "reasoning" mean to you?

[criddell]

How do you assess how true one's reasoning is?