There's an interesting theory that this is all that consciousness is: one part of the brain trying to explain the decisions of another part, a part into which it has no special insight.
That interesting theory is called the bicameral mind, and as far as I know it's widely considered pseudoscience and not taken seriously in any scientific field.
Also, it doesn't describe at all the way LLMs work, so it isn't even applicable.
Also, it doesn't describe at all the way LLMs work, so it isn't even applicable.