Hacker News new | ask | show | jobs
by outdig 966 days ago
I agree with jqpabc123 except for one point: that it cannot 'reason' and it is not smart. I disagree with this.

The reason it cannot play well is because it has very little 'experience' (training data) with it. It's been trained on 'what the game is', it has not been trained how to win.

You can think of it a bit like driving. You can know what driving is, but it doesn't make you a driver if you've never driven before.

You can ask a genius who's never played before to play tic tac toe with you, tell it the rules, they will likely not win on the first attempt or play optimally. This doesn't mean that person isn't a genius.

You said humans are able to 'learn' to play it rapidly. So is GPT, in training mode, it can process a million games in seconds, where a human can't.

The problem here, is it simply has no experience.

If I told you every time you played tic tac toe against me, you would forget all your experience the next time we played, would you play optimally?

1 comments

can process a million games in seconds, where a human can't.

A human doesn't need to. A human can apply reason and logic and at least play the game given only a few simple rules.

GPT has poor reasoning ability and doesn't comprehend the rules --- so it relies on database lookup to sorta fake it. Without this, it's kinda helpless. It clearly lacks any real comprehension --- aka "intelligence".

Using statistics, it can fabricate text that "sounds" plausible but it has no comprehension of the correctness (or lack there of) of what it produces.

But is that really the case? It's actually not just a database lookup. It is abstracting and compressing throughout the training process.

And it clearly learns certain rules about our world. It seems LLMs can reason, but reasoning is a big field and it hasn't mastered all it's forms, i.e. search future scenarios or spatial reasoning.