When Chomsky proposed generative grammars, his theory of universal language acquisition, and so on, they were radical ideas that upturned the central cannon of linguistics.
Time has been on his side - entire schools and subfields of linguistics went extinct as more evidence emerged that Chomsky was fundamentally right. Basically every computer language and data format in existence is parsed/lexed in ways inspired by his models of language.
But now Chomsky is considered the stodgy old establishment, and whenever one of his theories is contradicted somewhere on the margins people shout "Aha! He was wrong the whole time!" and ignore the 99% of cases where his models are still the best ones we have.
This is a hot take, would love a link/explanation on why you think neural nets are human-like. For example, from the op Ed you’re likely referencing:
“ Their deepest flaw is the absence of the most critical capacity of any intelligence: to say not only what is the case, what was the case and what will be the case — that’s description and prediction — but also what is not the case and what could and could not be the case. Those are the ingredients of explanation, the mark of true intelligence.”
Isn’t that just plainly true of LLMs? Sure they can produce text that looks like an explanation, and sure putting in a header telling it to spell out its reasoning will get it to output text that looks like reasoning, but I feel the nature of its hallucinations make it clear that it’s not actually performing those steps anywhere in the net.
But maybe I’m just a Luddite? These technologies are amazing and transformative, I’m just shocked to see hate on HN of CHOMSKY of all people, the father of modern linguistics and cognitive science…
Why do you think this is impossible? Have you tried making an account on chat.openai.com? Because it can in fact do that right now; and even people who are otherwise skeptical of LLMs have panned Chomsky's article.
He wrote an op ed recently with the oft-repeated argument that stochastic models are fundamentally distinct from structured symbolic/logical models. In simple terms you can never really “trust” chatgpt’s answers because it’s just guessing the answer that looks right, not applying structured reasoning like humans do.
> In simple terms you can never really “trust” chatgpt’s answers because it’s just guessing the answer that looks right, not applying structured reasoning like humans do.
That example was highly controversial, and I think Chomsky was actually right in that instance (all languages have recursion). Generally my understanding is that he's considered to have held the field of linguistics back quite a bit with a non-disprovable hypothesis.
He supported the communist though. He also supported Pol Pot. You can predict his opinions of foreign policy if you understand that he bases them on the "US is evil" axiom and therefore anyone who opposes it is good, no matter how actually evil they may be.
Chomsky absolutely was a Cambodian Genocide denailist at the time. He very arrogantly dismissed actual eyewitness testimony of the genocide from refugees purely for ideological reasons.
Did you skip my first link or are you disagreeing with it? It's about the same subject. And in your WP link has a second quote writing about the genocide as fact.
Chomsky's skepticism in the media criticism article talking (among other things) about a book about the then-contemporary events of course looks quite unfortunate in retrospect, but given the volume of work and constant writing about world events over a long career it seems to be a error in judgement in the moment, rather than denying history, especially as he evidently updated his views later as more evidence came about.
In the decade(s) since I kinda think "Chomsky was wrong" is pretty much the only reason people bring him up.