Hacker News new | ask | show | jobs
by SomeoneFromCA 736 days ago
It still does not proof anything, as claiming that "there is certain bias for Human Language built into our heads" is quite different thing that saying there is some universal grammar in the brain structures, as much we do not have innate abilities to comprehend calculus or play chess, yet we still able to learn it, with a lot less training information than LLMs. In fact 2 books will suffice for the both.
2 comments

My comment was more of a response to

> We may as well do it the way LLMs do

We almost certainly don't learn the way LLMs do, it's just too data inefficient.

And I don't see what current LLMs can say about a universal grammar in the Human brain, unless there is proof that a LLM-style attention mechanism exists in the brain, and that it is somehow related to language understanding.

We don’t learn language from textbooks though.