Hacker News new | ask | show | jobs
by IshKebab 19 hours ago
> Humans can solve novel problems using sparse information. LLMs can’t do that.

You haven't been following the news recently!

> Reasoning is a complex cognitive process that involves causal understanding, mental modeling, intentionality, and abstraction. Instead, transformer-based models statistically predict textual continuations based on patterns learned from extensive training data containing examples of human-written logical processes and problem decompositions.

You're conflating low level and high level functions. At a low level human brains are just sending electrical and chemical signals around. At a high level they are doing causal reasoning and mental modelling.

In AI, at a low level they are doing token prediction and matrix modelling. At a high level they are also doing causal reasoning and mental modelling.