|
|
|
|
|
by WitcHeart_Ruby
307 days ago
|
|
Thanks for your reply. I understand that LLMs don’t have self-awareness, and I’m familiar with the “stochastic parrot” idea — that what it says about what it knows is just a pattern from training data. Precisely because I know this, I’ve tried controlled tests: opening a brand new default conversation (not a custom GPT), across different devices, different accounts, and even in the free-tier environment with no chat history. In all of these cases, through casual conversation, ChatGPT was still able to indicate that it recognized me. I can demonstrate this phenomenon if anyone is interested, and would really like to understand how this could be possible. |
|
Indicate how? It just said that it recognized you? Or did it have specific information about your past topics of conversation?
LLMs tend to infer continuity, based on how you prompt them. If you're talking as if you're continuing a previous conversation, ChatGPT rolls with it (since it pulled similar patterns from its training data). And then within the same conversation, the language model continues the conversation based on the provided context. Because...that's how it works. Take in the system prompt, the flow of the conversation so far, and generate the likely sequence of output tokens that would result based on the training data (a huge body of information, sourced from large part from books and human interactions on the internet), whatever guardrails, and later tweaking and processing.