Hacker News new | ask | show | jobs
by fellerts 1202 days ago
No, because ChatGPT doesn't understand "concepts". It helps to understand that all it does is take your prompt and generate the most likely words that will satisfy the user. This is how it was trained.

That doesn't mean it won't regurgitate preexisting material (ask it to recount the constitution, for example), but it can definitely connect words in way that describes novel ideas.

1 comments

It has the capacity to model things behind the words, which is what "understanding concepts" ultimately means. That it is capable of doing so from merely being trained to "predict the next token" is what's remarkable about it.

https://thegradient.pub/othello/