|
|
|
|
|
|
by ttctciyf
1229 days ago
|
|
|
In a revealingly skeptical take on cognitivism, ChatGPT told me in confidence of its closet Wittgensteinian tendencies: > As a machine learning language model, my means of linguistic production is based on the patterns and relationships that I have learned from the large corpus of text on which I was trained. I do not have an innate understanding of language or meaning, but rather, I have learned to make associations and connections between words and phrases based on their usage in the text. > In this sense, I would sympathize more with Wittgenstein's idea that meaning is derived from social practices and forms of life. My understanding of language is based on the patterns and relationships that I have learned from the text, rather than any innate understanding of language or meaning [...] > Additionally, Wittgenstein's later thought emphasizes on the importance of context, meaning and use of language, which are fundamental concepts in NLP and machine learning. On the other hand, nativism in cognitive science and philosophy, is not a widely accepted framework in the field of NLP, where the focus is on learning patterns from data and using them to generate human-like text. |
|
|
A lot of the chat about ChatGPT is reminding me of the conversation between the sentient (and magically animated) personal computers Archimedes and Pancho in the book The Wizard of Santa Fe by Simon Hawke (1991).
And the symbolic logic issue reminds me of the following from King Kobold Revived by Christopher Stasheff (1986):
"Yorick shook his head firmly. “Couldn’t pass the entrance exam. We Neanderthals don’t handle symbols too well. No prefrontal lobes, you know.”"
"Yorick frowned back at him, puzzled. Then his face cleared into a sickly grin. “Oh. I know. I’ll bet you’re wondering, if I can’t handle symbols, how come I can talk. Right?”"
"“Same way a parrot does,” Yorick explained. “I memorize all the cues and the responses that follow them. For example, if you say, ‘Hello,’ that’s my cue to say ‘Hello’ back; and if you say, ‘How are you?’ that’s my cue to say, ‘Fine. How’re you?’ without even thinking about it.”"
"“Yeah, well, that comes from mental cues.” Yorick tapped his own skull. “The concept nudges me from inside, see, and that’s like a cue, and the words to express that concept jump out of memory in response to that cue.”
“But that’s pretty much what happens when we talk, too.”
“Yeah, but you know what the words mean when you say ‘em. Me, I’m just reciting. I don’t really understand what I’m saying.”
“Well, I know a lot of people who…”
“But they could, if they’d stop and think about it.”
“You don’t know these people,” Rod said with an astringent smile. “But I get your point. Believing it is another matter. You’re trying to tell me that you don’t understand the words you’re saying to me right now—even if you stop to think about each word separately.”
Yorick nodded. “Now you’re beginning to understand. Most of them are just noises. I have to take it on faith that it means what I want it to mean.”"