Hacker News new | ask | show | jobs
by makebelieve 3815 days ago
Searle is making an argument about awareness. That a computer system is explicitly unaware of any of it's content. That it's programs are functions and the data also performs a purely functional role. In essence, computers cannot engage in acts of meaning. The programmers and users are engaged in acts of meaning.

For instance, saying a program "has a bug", is a completely misleading statement. No programs have bugs. It is impossible for a program to have a bug, just as it is impossible for a physical process to "do something wrong". Programs do what they do, just as molecular processes do what they do. The concept of error and meaning does not exist in a program, just as it does not exist in the physical universe. Meaning (and errors and bugs are a kind of meaning) are things outside programs and outside physics. When a program "has a bug" it means the programmer screwed up, not the program. A program cannot produce errors, because programs, and computer systems in general, do not have the capacity to have meaning. This is what Searle is demonstrating with his argument.

This is true for all the popular computational approaches we have today. However, because the human brain appears to function in a purely physical way, and computers function in a purely physical way, it should be theoretically possible to create a computer system that is conscious and aware of meaning just as we are. You refer to this as "Strong AI". Other refer to it as Artificial General Intelligence. I refer to this as machine consciousness. To solve the machine consciousness problem means understanding how awareness, meaning, and representation in general, works. Then building a computer system that engages in representation and instantiates awareness.

If an actual person were put into Searle's box, the person would learn chinese. Also, the person could 'intentionally' produce incorrect answers annoying the "programmers" who set the box up in the first place. But a modern computer system cannot 'intentionally' produce errors. it's completely non-sensical to talk about computers as having intention at all. programmers have intention, not computers.

Solving the intentionality problem is the other leg of machine consciousness. Elon Musk, Steven Hawking, Nick Bostrom and others make arguments about the dangers of an AI (of any variety) which may acquire intentionality and representational ability, while ignoring the actual deep problems embedded in acquiring those abilities.

Awareness, representation, and intention are so fundamental to experience that we have a very difficult time understanding when they happen and when they do not. We see a representational world all around us, but very explicitly, there are no representations at all in the physical world.

I believe machine consciousness is possible, but none of the existing approaches will get us there. Searle's chinese room is one succinct argument as to why.

The approach I am taking is a kind of metabolic computing. Where single function processes interact in some way similar to molecular interactions and those processes are developed to produce, computational structures like membranes and DNA and eventually "cells". These cells then form multi-cellular structures. These multi-cellular structures and underlying "molecular" interactions instantiate representations and representational processes, like a nervous system. A computational nervous system which embodies representation, intention, sensation, action, imagination, and because it engages in representation making, would be aware.

I would love to hear someone describe how any kind of computational approach can produce meaning inside a computer system. We produce meaning and representations so easily; it's hard to understand the difference of perspective necessary to see how representations must form. If someone has an easier approach than the one I am taking, I would be very interested in seeing how they solve the problems of meaning and intention with code.

2 comments

I can't see your side of the chinese room. A sufficiently complex digital system can simulate any analog one; the human brain is an analogy system; therefore, a digital system could simulate the human brain; therefore, if a human brain is conscious, or can produce meaning, a digital program can do the same thing. The simulation might be probabilistic, it might be stochastic, but it'd still be a digital simulation. We could simulate it atom by atom with a computer the size of the sun if that's what it'd take, but it could still be done. I don't see how the specific "hardware" that the mind runs on, whether made of membranes or transistors, has anything to do with it, nor the level of abstraction. How is there anything more to the discussion?
a system that simulates some process or system is not the process or system it simulates.

Just take writing programs: Can we simulate the process of writing programs? Could we create a system that writes and compiles programs? What about writing programs which contain errors? Could that system recognize the errors in those programs it wrote and correct the errors? could it write programs and then optimize those programs? Or rewrite the programs to make them more efficient or tweak them to do other tasks? Does "simulation" actually help us create a computer that can write programs at all? If so, how?

If you know how to write a program that can write and optimize programs, Google will hire you tomorrow! And it can't be that hard. It's just combining ascii characters together into combinations based on some rules...

Error making is the essence of actual learning, because it is a component of comprehension. Simulation, automata theory, mathematics itself, do not address issues of comprehension or error recognition. How can a computer system make, recognize, and correct errors? Errors do not actually "exist". Errors are things we apprehend but which have no obvious physical counterpart.

We do some simulation of atoms, but it is laughably inefficient. Think about the simulations we do to figure out protein folding. Protein folding is going on in every neuron with each synaptic firing. Protein folding not performed by a rule or an extrinsic function, but is an intrinsic process of the molecule itself. For instance, how do a few molecules of LSD produce such an incredible change in actual experience? How would you go about simulating psychedelic phenomena? How would you go about simulating wave lengths of light as colors? How would you simulate colors (as in dreams or imagination) without the corresponding wavelengths of light? How would you simulate what sound is?

We can certainly produce and record vibrations with speakers and microphones attached to computers. But what is the experience of sound? when you hear someone's voice in your head, what is that? it's not a vibration, it's not a string of ascii characters, it's not a wav file.

What you experience looks easy because experiences occur effortlessly to you. Now try to write a program that can be aware of something, that can think about something, that has experiences. That is Searle's point, our computers have no experiences at all.

If I say: "Don't forget to brush your two teeth with your toothbrush." You will understand what the "twos" mean. A computer has no comprehension of to, too, two, 11, or 2. It's not just too hard for a computer to do, it's a categorically different problem. To get a better understanding of these problems you could read about qualia https://en.wikipedia.org/wiki/Qualia. and then wonder how you could get a computer to see magenta. And then wonder how you could get it to like Pink (the singer).

I agree with you totally, if you wanted to talk about this more and your approach then my e-mail is: w.sierocinski-a-gmail.com