Hacker News new | ask | show | jobs
by jchmrt 1273 days ago
I think it's really problematic to use the word "reason" to describe what GPT does. As others have commented in this thread, GPT is a language model, which in no way reasons about anything it writes. It is simply writing whatever fits statistically to the prompt and context. Attributing reasoning or too much intelligence to this could prove quite dangerous.
1 comments

> As others have commented in this thread, GPT is a language model, which in no way reasons about anything it writes. It is simply writing whatever fits statistically to the prompt and context.

Those people are wrong; statistics are a kind of reasoning (intuition) and if you try it, it obviously does the other kinds of reasoning too. I have all kinds of answers from it that are logically coherent and can’t possibly have appeared on the internet already.

(Try asking it to write new SCP wiki entries.)

Just because some of its answers are logically coherent due to it following statistical patterns, does not mean that the model is reasoning. Reasoning implies some type of discipline which prevents nonsensible arguments (even in uncommon situations).
No such thing as “is reasoning”, only “does reasoning”. Are you an unreasoning being if you make a math mistake?

You can see it “does” reasoning if you say “think step by step” after a question. It can attend over its steps then.