Hacker News new | ask | show | jobs
by svachalek 1171 days ago
If you really force it to reason, rather than regurgitate arguments from its training set, you will find it is nowhere near the genius line. Make up some rules and have it try to answer questions according to the rules. In my experiments I feel it's something like a 4 or 5 year old child both in its logical limitations and penchant for distraction.

However it's important to note one VERY important thing -- this is not a system that is designed to reason! At all, as far as I know. That just fell out of its ability for language somehow. So to just accidentally be able to reason like a 4 year old human (which are vastly clever compared to the adult of any other animal species I'm aware of) is incredibly impressive and I think the next obvious step is to couple this tech together with some classic computing, which has far exceeded human capabilities for logic and reason for decades already. If ChatGPT has some secondary system for reasoning and just uses the LLM for setting up problems and reading results, I think it could reach superhuman levels of reasoning quite easily.
3 comments
bakuninsbart 1171 days ago
Agreed, but let's not forget that Carnap started his AI company last year with the express goal of reaching AGI comparable to a 'retarded toddler' by 2030. Relatively simple generative AIs have come far far further than anyone really anticipated, and it is quite unclear if the last 20% to avg-human-level AGI will be much harder, impossible, or also suddenly be solved. I mean, hell, GPT4s context space is still relatively small, it doesn't have a memory, and is still producing quite impressive results in simple reasoning tasks.
link
stephendause 1171 days ago
Re: your last sentence, I'm fairly certain this would fall under the category of neuro-symbolic AI. It, too, seems to me like the logical next step.

https://en.m.wikipedia.org/wiki/Neuro-symbolic_AI

link
dmreedy 1171 days ago
> this is not a system that is designed to reason

For what it's worth, neither are we, really. Not disagreeing with anything you're saying, just musing.

> superhuman levels of reasoning

This one has always stumped me a bit though. I'm not quite sure what that looks like. Laplace's Demon?

link