Hacker News new | ask | show | jobs
by strogonoff 766 days ago
> there is quite a bit of evidence that the causality of that particular mechanism (if I'm understanding you correctly -- you are being pretty imprecise here) runs in the other direction.

Not if you look thoroughly. There is no proof that causality runs[0] in either direction, and in all likelihood it would remain so for as long as the hard problem is unsolved.

> AFAICT the way in which minds arise from chemistry is pretty well understood.

That would be immensely groundbreaking, absolutely historical news that would eclipse LLMs, reverberate HN for months and would not pass either of us unnoticed.

> In fact, it is sufficiently well understood that we are on the cusp of being able to create artificial minds that are not based on chemistry.

Have you heard about the so-called Chinese room experiment or the concept of a philosophical zombie?

> I don't see any uncertainty to acknowledge.

That’s because you have adopted a philosophical position implicitly.

> Yes, but I think your attempt has failed.

You have not even attempted to object by providing a counter-argument, though.

[0] Side note: even though I am guilty of thinking that way myself, I find the whole notion of “causality running” smelling of Cartesian dualism and another inheritance of our religious past. A theory presupposing the existence of two different kinds of things (as in this case, mind vs. physical), while useful in its own ways, is necessarily less elegant than a theory that can manage with one.

1 comments

> There is no proof

You need to read this:

https://blog.rongarret.info/2024/04/three-myths-about-scient...

Focus on myth #3.

> That would be immensely groundbreaking

Yes, it was [1]. Still is, as this work is on-going [2].

> Have you heard about the so-called Chinese room experiment or the concept of a philosophical zombie?

Yes. Have you heard of the Turing test?

For the record, the Chinese Room is based on the false premise that the Chinese Room is possible. It isn't. The person inside the room would be dead long before it emitted its first symbol. And philosophical zombies are IPUs [3].

> That’s because you have adopted a philosophical position implicitly.

No, I have adopted a philosophical position explicitly [4].

> You have not even attempted to object by providing a counter-argument, though.

Perhaps you are unaware that I am the author of TFA [5]? Did you read it?

---

[1] https://www.cs.virginia.edu/~robins/Turing_Paper_1936.pdf

[2] https://en.wikipedia.org/wiki/Computational_neuroscience

[3] https://blog.rongarret.info/2024/04/feynman-bullies-and-invi...

[4] https://blog.rongarret.info/2024/03/a-clean-sheet-introducti...

[5] https://news.ycombinator.com/item?id=40205012

> Focus on myth #3.

If you don’t like the word “proof” then replace it with the phrase “conclusive evidence”.

> Yes, it was [1]. Still is, as this work is on-going [2].

Sorry, how does any of that show that “minds arise from chemistry”?

> Yes. Have you heard of the Turing test?

Yes, and a Chinese room would pass the Turing test by its very definition.

> The person inside the room would be dead long before it emitted its first symbol.

Replace the person with a powerful CPU.

> And philosophical zombies are IPUs [3].

In this context a philosophical zombie is an instance of a Chinese room, which are fairly real things. Take a sufficiently advanced LLM, or an emulation of human brain, and you get one. (Showing that it is not a philosophical zombie would call for some conclusive evidence showing that the phenomenon of consciousness is caused by whatever entities feature in models from today’s natural sciences—so that manipulating them in a particular way is enough to cause consciousness to magically arise.)

> Perhaps you are unaware that I am the author of TFA [5]? Did you read it?

That slipped my mind after a while, but I don’t think it invalidates the discussion. I skimmed it back when it was posted and generally I have been familiar with the illusionist takes on consciousness for a while. As monistic materialism (as well as cartesian dualism) in general, they always strike me as inelegant and needlessly contrived. (When competing hypotheses cannot be falsified due to limitations of scientific method, beauty and elegance remain as qualities we can judge them on, and I find that beauty inversely correlates with the number of entities a given hypothesis must magically conjure into existence.)

> how does any of that show that “minds arise from chemistry”?

That's too long a story for an HN comment (which is the reason I referred you to an entire field of study) but the TL;DR is that the only reason we have to believe that minds exist at all is the I/O behavior of things that purport to have them (i.e. people) and that I/O behavior can (as far as we can tell) be completely accounted for the the behavior of neurons, which can be completely accounted for by chemistry.

> Replace the person with a powerful CPU.

That completely eviscerates the experiment. The whole point of the Chinese Room is that there is a conscious person inside who does not speak Chinese. Without that, the Chinese Room is just a run-of-the-mill AI.

> Showing that it is not a philosophical zombie would call for some conclusive evidence showing that the phenomenon of consciousness is caused by whatever entities feature in models from today’s natural sciences—so that manipulating them in a particular way is enough to cause consciousness to magically arise.

Where is your "conclusive evidence" that this "phenomenon of consciousness" actually exists?

If an AI exhibits I/O behavior that is indistinguishable from a human (i.e. can pass the Turing test) then on what basis can you call one a "philosophical zombie" and not the other?

> they always strike me as inelegant and needlessly contrived

What is your alternative?

> that I/O behavior can (as far as we can tell) be completely accounted for the the behavior of neurons, which can be completely accounted for by chemistry

Thing is, this can be explained the other way around. If neurons & chemistry were merely how conscious phenomena appear (a map of the territory), the observed outcome would not change. (Most of chemistry, physics, etc. all work equally well in that scenario, by the way, but there may be implications in other fields.)

By the way, reducing everything to I/O behaviour is also a philosophical position, I believe it’s called behaviourism.

> The whole point of the Chinese Room is that there is a conscious person inside who does not speak Chinese.

Neither does a powerful CPU/an LLM—the point of putting a slow person that doesn’t speak the language is to illustrate on an intuitive level what happens with a fast program that does the same, just in the blink of an eye.

> Where is your "conclusive evidence" that this "phenomenon of consciousness" actually exists?

You want to attribute me a claim I do not make. There is no conclusive evidence either way, and it could be impossible to obtain any (at least within the framework of scientific method). However, a theory where it does not exist has major logical flaws in my view.

> If an AI exhibits I/O behavior that is indistinguishable from a human (i.e. can pass the Turing test) then on what basis can you call one a "philosophical zombie" and not the other?

Hinges on the hard problem. If you claim consciousness does not exist, then you have your answer and I have mine, but I would object to treating it as a fact.

> What is your alternative?

I would not claim to have my own, but variants of monistic idealism as I understand them presuppose the objective existence of consciousness and go from there. I find that way we may have to magically conjure out of nothing much fewer entities and arbitrary rules, and don’t have to explain away the only phenomenon we have direct access to.

> this can be explained the other way around

I suppose. So? Why do you think that matters?

> reducing everything to I/O behaviour is also a philosophical position, I believe it’s called behaviourism

I'm not "reducing everything to I/O behavior", I'm just saying that you have no evidence for the existence of consciousness in entities other than yourself other than their I/O behavior.

> the point of putting a slow person

You have completely misunderstood the point of the Chinese room. The speed at which the person operates is completely irrelevant to the argument, it is only relevant to my counter-argument. The whole point of my counter-argument is that the original argument is invalid because it ignores the speed at which a human can execute the rules. The speed matters. It's not the only thing that matters, but it's one of the things, and the fact that Searle ignores it enough to invalidate his argument.

> There is no conclusive evidence either way

There is for me. Consciousness is something I directly experience. Maybe it's different for you, but I'd be really surprised. But (and this is where I predict we will diverge) I believe that this experience is an illusion, just as my experience of motion when looking at Moving Snakes is an illusion.

> If you claim consciousness does not exist

I do not claim that it does not exist, I claim that it is an illusion. Illusions exist, they are just not what they naively appear to be.

> we may have to magically conjure out of nothing much fewer entities and arbitrary rules

What entities and arbitrary rules need to be "conjured out of nothing" to support Dennett's thesis? In fact, it's the exact opposite: presupposing the objective existence of something for which there is no evidence, and quite a bit of evidence that our perception of it is an illusion, that seems more like "conjuring something out of nothing" to me.

> I suppose. So? Why do you think that matters?

Why do you think it matters? If you didn’t think so, presumably you would not yourself be arguing for a particular explanation (e.g., neurons causing consciousness).

I can pick between a few reasons why it matters to me. One of them is probably similar to why you or I would think that believing or not believing in a deity matters.

> you have no evidence for the existence of consciousness in entities other than yourself other than their I/O behavior.

I don’t need that evidence if I assume consciousness exists in the first place. You need it if you believe it arises from some configuration of entities in external reality.

> The whole point of my counter-argument is that the original argument is invalid because it ignores the speed at which a human can execute the rules

Why does the speed matter?

> I do not claim that it does not exist, I claim that it is an illusion. Illusions exist, they are just not what they naively appear to be.

Would it be fair to say that time-space is an illusion? It seems that “it is not what it naively appears to be” is a true statement about it, doesn’t it?

> presupposing the objective existence of something for which there is no evidence

The evidence of consciousness is empirically supplied every moment of your existence, though. Empirical evidence of anything else by definition requires consciousness, too.