[int_19h]

If I tell it to do X, and it does X, for all practical purposes it means that it understood what I said.

[riku_iki]

it was taught to react in specific way on specific word, the same thing you can train dog to bark on "quantum physics" phrase.

[int_19h]

It can invent words, and then correctly use them to compose.

https://news.ycombinator.com/item?id=35268950

[riku_iki]

it can invent words, because gpt is amazing pattern extrapolator.

[int_19h]

Okay, but who "taught it to bark" correctly in response to those words?

[riku_iki]

you can read papers how gpt was trained?

[int_19h]

You're making a specific claim here: "it was taught to react in specific way on specific word", and I'm giving you a specific example of an invented word that GPT used to full effect when composing. Can you explain how it was "taught to react" to this word in a manner that enables it to use it in the new meaning that wasn't even in its training set?

[pixl97]

Well if it can bark out the right answer its an impressive damned dog...

[riku_iki]

the thing it doesn't bark right answer very often, but bark non-sense because was training on predicting next word in sentence.