Hacker News new | ask | show | jobs
by csr86 478 days ago
Animals are not next token predictors. Most animals don't have language and don't generate sentences/ideas. It is unique feature of humans and big part of our success.

Animals do have sensors and can reason about real world quite intelligently. This is what LLM- models don't have. Surely, all the text in Internet has a lot of textual information about real world, but something "obvious to animal" might not be there.

I feel us humans are kind of both: We have sensors and experiences about real world, but also oral and written tradition.

Once we develope LLM- with cabability to sense and experience real word (perhaps with some evolutionary algorithm to make it better over time) it should start to be close to human beings.