[IncRnd]

ChatGPT doesn't understand. Consider that two exactly identical runs will generate different results. We can use this to explore understanding.

To start, make chatgpt do something that you would believe would take understanding. For example, make it run linux like at this link.

https://medium.com/@neonforge/i-knew-it-chatgpt-has-access-t...

Now, after you run the first command, chatgpt will sometimes run one kernel version and sometimes another (according to uname -a). Sometimes there will be network access, and sometimes there won't. You can even trick chatgpt into believing there is internet access, after which other "cue card" contents will be returned.

There really isn't any understanding. The responses are equivalent to googling the internet, where sometimes people get articles about how to run ls on ubuntu and sometimes get articles about how to run ls on redhat.

You can even cause chatgpt to prune after a portion of the conversation, after which completely different responses get generated. It's not understanding but may contain more entropy than many people's passwords...