Hacker News new | ask | show | jobs
by benlivengood 628 days ago
I think a lot of people don't abstract their brain model when they say "models a human brain", or they'd say "models biological intelligence", etc. Specifically, I don't think there are any human traits in LLMs other than having mostly been trained on human outputs. They see tokens and predict tokens; very different sensorium from humans. There aren't any specific corvid or cephalopod traits either afaik.

Biological brains don't use gradient descent and don't seem to use 1-hot encoding/decoding for the most part.

2 comments

Pointing out differences doesn’t mean it’s not a model, that’s what makes it a model and not a replica. Saying „A neural network is a model of the human brain“ doesn’t imply that it’s a direct simulation of the structure and scale of a human brain, it just means that the neural network is based on a simplification of how neurons in a brain work. That’s the entire claim.
How about "hallucinations"? They are exactly what students produce during exams when they don't exactly know the subject: plausible sounding but internally incoherent sentences.