[flyval]

> I don’t think it’s actually reasoning about things at all

This is a huge leap. There’s plenty of humans who couldn’t do that, especially historically.

Stop thinking about reasoning as a binary question and think of it as a spectrum. Actually, not even a spectrum, but a huge multi-dimensional problem. ChatGPT does better at some reasoning problems than most humans do, and worse at some others. You clearly found one that it’s particularly bad at.