[jchmrt]

Just because some of its answers are logically coherent due to it following statistical patterns, does not mean that the model is reasoning. Reasoning implies some type of discipline which prevents nonsensible arguments (even in uncommon situations).

[astrange]

No such thing as “is reasoning”, only “does reasoning”. Are you an unreasoning being if you make a math mistake?

You can see it “does” reasoning if you say “think step by step” after a question. It can attend over its steps then.