Hacker News new | ask | show | jobs
by fuligo 4116 days ago

  Computers are very, very, very far from being like humans, especially 
  when it comes to consciousness. The problem is different, that the system, 
  the military and economic and political system doesn't really need 
  consciousness.
Consciousness is a poorly defined concept with many unfortunate connotations, but let's assume in this context it's the same as self-awareness. I assert it's very likely that nature didn't evolve conscious brains by accident, it's probably a byproduct of making an intelligence that can reason about itself and its environment.

I know it's just a thesis, but when you think about what our mindless AIs lack, it makes sense. They're characterized by a complete incapability for global reasoning and an inability for personal consideration. You might argue, as the article does, this is exactly how we want our tools to behave, but then we might have to accept there could be hard limits on the complexity of mental tasks these systems are able to perform without access to higher reasoning.

6 comments

> I assert it's very likely that nature didn't evolve conscious brains by accident, it's probably a byproduct of making an intelligence that can reason about itself and its environment.

I think you're exactly right; Michael Graziano's theory of consciousness it that it starts as a necessary function for modeling the attention of an agent and turns into awareness when the brain itself is modeled as an agent. First, a specialized brain function for agent modeling of predator/prey/rival/mate evolves as a good trait for survival. Part of that function entails modeling what an agent is attentive to. However, once this agent model discovers the brain it is running on, a new agent is recognized, and attention now becomes redundant and is instead reported as awareness of attention, which has to feel subjectively like a secondary aspect of primary sensory information. It's a nice logical progression. http://www.ncbi.nlm.nih.gov/pmc/articles/PMC3223025/

"Self awareness is a byproduct of an intelligence that can reason about itself" looks like a tautology to me. I've heard similar theories proposed that extend to broader notions of consciousness, but I don't find the argument very compelling. It's very easy to see why self-awareness is required in nature: intelligence won't do any good for an organism unless it is self aware and has a survival instinct. That pressure clearly doesn't apply to man made machines.
>it's probably a byproduct of making an intelligence that can reason about itself and its environment.

I think this is exactly right. In fact my suspicion is that "consciousness" is an emergent property of feedback from high resolution sensors. Stated another way, it's a constant internal inventory of everything that can be controlled through the same volitional system.

The word "Consciousness" is almost like the word "God".

Many people seem to know what it is, no one can actually define it, and it has never been measured, located or proven to exist.

Maybe we should stop using it altogether.

I wouldn't go as far as stopping to use it altogether, but when discussing things it might be worth a while to taboo it [0]. It's a very helpful trick; [1] explains it nicely.

[0] - http://wiki.lesswrong.com/wiki/Rationalist_taboo

[1] - http://lesswrong.com/lw/nu/taboo_your_words/

We should either stop using it, or at the very least own up to what it is we're [trying to] talk about: http://consc.net/papers/facing.html
Going to read that in earnest, did a quick scan (not my native language) and yes: i want to differentiate here between the not-asleep and the i-think-i-know-i-am-thinking type of consciousness. It's not only experience, but knowing or thinking to know your own experience.

Furthermore, it seems only to exist or pinpoint when you're communicating with another person. In total solitude, boundaries between your self-image and the other(s) just don't hold up, and the whole thing becomes almost meaningless.

Edit: the concept of time seems to be connected to it as well, but i really need to read this paper first now, i think :)

I wouldn't go that far. Consciousness is the result of algorithms properly functioning in my brain chemistry which allows me self-awareness.

Our brains process information in a certain way due to evolution, therefore, we are.

I root all these things into survival. So far computers are 2 years old, without humans to lay infrastructure, renew, fix computers would stop functioning pretty fast.
> it's probably a byproduct of making an intelligence that can reason about itself and its environment.

See Jaynes' bicameral mind hypothesis. Even if it's most likely a mistaken theory it's still interesting as a distinction between intelligence and consciousness.

> it's very likely that nature didn't evolve conscious brains by accident, it's probably a byproduct of making an intelligence that can reason about itself and its environment.

Strictly speaking, everything in living nature is an "accident". Natural selection acts on "accidental" random mutations. It's not a directed process.

I'm not sure the original comment deserves this clarification, you'll be hard pressed to find someone on this forum who didn't already know about the nature of mutations.

The point is though that while the mutations themselves are "accidents" and the result is always characterized by a certain randomness, evolution as a problem-solving algorithm isn't itself accidental. While some (or even many) if the characteristics of an organism might be incidental, some major features tend to have a good reason for being selected. Self-awareness, I assert, is such a feature, because it carries implications too large not to have an effect on selection.

> Self-awareness, I assert, is such a feature, because it carries implications too large not to have an effect on selection.

You might assert that, but there's virtually no evidence to support that assertion, and interesting philosophical arguments to the contrary: https://en.wikipedia.org/wiki/Philosophical_zombie

Now, if what you mean by "self-awareness" is just the ability of an organism to monitor its own condition and respond accordingly, then we're in agreement, but I find that a very uninteresting assertion and it means that we're not really talking about "consciousness" except inasmuch as a thermostat is conscious: http://consc.net/notes/lloyd-comments.html

P-zombies are not an interesting philosophical argument anymore than "Angels dancing on pins" is an interesting argument.
Parent comment is asserting that consciousness/self-awareness is an evolutionarily important feature, that consciousness is favored by natural selection.

P-zombies are vivid counterexample that points to the possibility of epiphenomenalism. There's no reason to believe that consciousness is a necessary feature for an organism to respond to its environment in a survival-enhancing way. In fact, there is some neurological evidence that suggests nerve impulses to take an action precede conscious awareness: http://www.consciousentities.com/libet.htm

P-zombies don't exist, so they are not a counterexample to anything. In fact, they cannot possibly exist, so they don't even point to the possibility of anything interesting.

>There's no reason to believe that consciousness is a necessary feature for an organism to respond to its environment in a survival-enhancing way.

The reason to believe this is that systems with "consiousness" are a strict superset of systems with "responding to the environment." They are not unrelated ideas, and in fact, the ability of an organism to survive is closely tied to this kind of behavior.

I have never heard anyone try to defend P-zomies unless they were simply unaware of what the word 'meaning' means, or how our words acquire meaning. If you know how this works, you should be able to easily see why P-zombies are a meaningless idea -- an incongruous hypothetical. (Like "what would we be talking about if I didn't exist?")

Same goes for Searle's Chinese Room argument. If you assume something that is impossible, it is easy to conclude any ridiculous thing you like. P-zombies are impossible. They are not anymore useful than any other self-contained contradiction.

The mutations are random, but the selection isn't... it's governed by the environment.
You realize that randomness and "accident" are man made concepts, they don't exist in nature. Something we can't predict isn't random at all, with enough data one could forsee anything, even the fact that you were about to write that message and the exact words I would use to answer you.

It's beyond science, but I don't believe in randomness or chaos, which doesn't mean I believe in religion either( which are just a collection of myth, which says absolutely nothing about the fundamental nature of 'god').