There is, you talk to an Alzheimer patient and its like that, and it doesn't feel like talking to a human any more. An Alzheimer patient isn't cured by adding some input noise to stop them from repeating conversations, they are still unable to learn, just like an LLM.
this just means they are incomplete, like a baby that has no long term memory. I think the baby analogy will hold up as we build more and more capability.