|
Computers are very, very, very far from being like humans, especially
when it comes to consciousness. The problem is different, that the system,
the military and economic and political system doesn't really need
consciousness.
Consciousness is a poorly defined concept with many unfortunate connotations, but let's assume in this context it's the same as self-awareness. I assert it's very likely that nature didn't evolve conscious brains by accident, it's probably a byproduct of making an intelligence that can reason about itself and its environment.I know it's just a thesis, but when you think about what our mindless AIs lack, it makes sense. They're characterized by a complete incapability for global reasoning and an inability for personal consideration. You might argue, as the article does, this is exactly how we want our tools to behave, but then we might have to accept there could be hard limits on the complexity of mental tasks these systems are able to perform without access to higher reasoning. |
I think you're exactly right; Michael Graziano's theory of consciousness it that it starts as a necessary function for modeling the attention of an agent and turns into awareness when the brain itself is modeled as an agent. First, a specialized brain function for agent modeling of predator/prey/rival/mate evolves as a good trait for survival. Part of that function entails modeling what an agent is attentive to. However, once this agent model discovers the brain it is running on, a new agent is recognized, and attention now becomes redundant and is instead reported as awareness of attention, which has to feel subjectively like a secondary aspect of primary sensory information. It's a nice logical progression. http://www.ncbi.nlm.nih.gov/pmc/articles/PMC3223025/