| It's only wrong because it's not really an explanation. At best, it's a weak one. Saying that an active model of self "is" what we experience as the consciousness we experience doesn't tell us why we have that experience. We can just as easily imagine a complex machine with an active self-model that isn't conscious, as one that is.[1] So an active self-model doesn't tell us about consciousness. This shows them to be different concepts, not different names for the same concept. Which means neither "is" the other, and "is" is not an explanation. [1] (To be a little more picky, we can't imagine that if we insist they are the same thing, but that leads to circular reasoning here. Our questioner can imagine both, and for an explanation to explain it needs to address the question, not wave it away by offering something circular.) It all sort of falls apart when we only talk about whether an object other than ourselves is conscious or not. As far as we know[2], we can't distinguish consciousness of other objects by observation. A hypothetical non-conscious machine might tell us it is conscious; we will never know if it's GPT-3000 talking or if it's another being like ourselves. So eventually we'll probably decide that it's moot, and treat it as conscious if it behaves convincingly and consistently like it is. [2] That could change, it's not ruled out. But that doesn't deal with the "hard problem" of consciousness, which is ourselves. For ourselves, we are in no doubt about the direct experience of our own consciousness. We might convince ourselves that it's just an active self-model, processing, because of how we think of data processing machines these days. But we shouldn't, for one because that's a weak explanation that doesn't explain, and for two because there are other active self-models in the universe, and also in the much larger abstract realm of "unexecuted" self-models that could exist (pick an RNG seed and set of rules of your choice). We don't experience those, so the one(s) we do experience are notably distinct, for no obvious reason. |
it seems to me the only rebuttal is "sure, self-models can exist but it's concievable that they can exist without an observer, so why is there an observer?" and to me it sounds similar to "sure, an eye can exist without abiogenesis, so why do we only find it in organisms that resulted from abiogenesis?"
an eye is just a collection of amino-acids, nothing prevents an eye from spontaneously assembling in a primordial soup and we recognize that's absolutely impossible. however i would posit that due to configuration of physical interactions in our universe, it's virtually guaranteed for an eye to develop in any life-form that is exposed to star's radiation in earth-like conditions.
similarly, just that we can think of p-zombie doesn't mean it's a simpler system to natually occure. we don't have understanding of building blocks of consciousness like we do with chemistry and biology but the answer to the why question seems to be quite simple: we observe ourselves because we evolved to. and we can find more and more primitive examples of self-observation in more and more primitive animals, so it's not some binary phenomena.