Hacker News new | ask | show | jobs
by TeMPOraL 413 days ago
They're fully aware of the obvious fact that LLMs are getting better at reasoning than humans at scale in general, and this includes power efficiency too. Meanwhile, what is not getting comparably better is robotics. This leads to obvious conclusion about natural order of things and division of labor: computers are for thinking, humans are for doing manual labor.
3 comments

> the obvious fact that LLMs are getting better at reasoning than humans

I wanted to say that you were wrong, that LLMs can't reason and so it certainly isn't an obvious truth that they do it better than humans, but when I asked AI if LLMs can reason it told me that they can't which (while still not being reasoned by the LLM) seems to support the spirit of your claim since it gave a correct answer while you (a presumed human that can reason) got it wrong.

We might be elevating the importance of reasoning too much because us humans need to use it to solve many difficult problems. But if intuition was stronger, conscious/explicit/logical reasoning might not be needed. Didn't the famous mathemetician Ramanujan say that God gave him his answers in his dreams? That sounds like really powerful intuition like an LLM. Us humans can already solve a lot of incredibly complex problems intuitively, but they're quite domain-specific, like for spatial navigation and social interaction.
Anthropologist Gregory Bateson predicted we'll know machines are conscious when we ask a question and the computer responds, "That reminds me of a story."
How are you defining “reasoning”?
That seems to be the hangup. I have to use a definition that would put it on equal footing to what we do as humans since that's the comparison being made.

Computers and software can be said to "understand", "think", and "reason" in their own way and informally people have always used those words in that context. Recently, software which has been trained on human-reasoned output is producing text that mimics reasoning well enough that it can be confused for the real thing, but nobody has been able to show that any reasoning (as a human reasons) is what's occurring.

Why do you care if the software 'reasons'?

If the output it produces is as useful to me as the output produced by a human with the magical and expensive capability to 'reason', why should I care?

You didn't answer my question.
There are several that would apply. Let's use this one as an example: Reason is the capacity of consciously applying logic by drawing valid conclusions from new or existing information, with the aim of seeking the truth.
I don't think you need consciousness to reason. I don't see why repeated application of rewrite rules to extrapolate logical conclusions from antecedents shouldn't be considered reasoning. LLMs are perfectly able to match and apply rewrite rules, while using fuzzy concepts rather than being bound to crisp ontologies that make symbolic reasoning impractical to scale up. And for better or worse, LLMs can also apply simplified heuristics and rules of thumb, and end up making the same mistakes that humans make.
> consciously

What does this mean?

Well, don't blame me, I voted for Kodos...
Kodos the Executioner, or the Rigelian from The Simpsons?
I’m excited at our future where we’re mind-stapled together to be used as meat for our AI overlords to enact their obtuse plans.