[ramon156]

Something that is still not clear to me is, what is conscious even. It references the Chinese Room experiment:

> Suppose that artificial intelligence research has succeeded in programming a computer to behave as if it understands Chinese. The machine accepts Chinese characters as input, carries out each instruction of the program step by step, and then produces Chinese characters as output. The machine does this so perfectly that no one can tell that they are communicating with a machine and not a hidden Chinese speaker.

But what makes a human mind more "understanding"? Who says we're not simulating? Who says our mind even exists, in this space?

We're also a neural network, are we any more clever than a simulated one?

[projektfu]

I think these questions were addressed by Searle[1]. His argument is not that AI is impossible, it's that the existence of surprisingly human-like behavior doesn't turn a non-cognitive system into a cognitive one. The strong AI hypothesis is that you can make a computational system where, if its output is similar to what a human would produce by cognition, the system must model cognition. The Chinese room is an argument against that hypothesis.

The paper also provides some suggestions as to where cog sci needs to go to make AI possible.

From my viewpoint, if you really think that LLMs can model cognition, then you are also going to have to bring along a model of human cognition to compare it to, and you have to do it "under the hood" as it were. The external behavior is not enough. In my formulation, if a space alien showed up with vastly different biology but appeared to be cognitively conscious, we may or may not want to believe in its cognitive ability, but it's just whattaboutism to use this hypothetical alien to argue for consciousness of the LLM.

1. https://www.cambridge.org/core/services/aop-cambridge-core/c...

[rickydroll]

Which category do Bumblebees play with balls fit into?

https://www.cnet.com/science/biology/bumblebees-like-playing...

[projektfu]

Aliens

[wolttam]

Consider cognition as simply the manipulation of information and data into something different and LLMs can do plenty of that.

Animals perform cognition.

We shouldn't confuse consciousness or agency or with cognition.

[projektfu]

That seems like moving the goalposts to a place where the GP (or anyone in the field promoting "artificial intelligence") wouldn't want to move them to.

[pron]

> We're also a neural network, are we any more clever than a simulated one?

This is tangential, but it is highly unlikely that we are "a neural network". Neural networks are an architecture loosely inspired by some aspects of the brain, but e.g. it's highly unlikely that we learn by backpropagation (neural signals don't travel in that direction). The brain is a network of neurons, but neural networks are something else. Neural networks probably don't work as the brain does.

[qsera]

I think we can talk about intelligence without introducing consciousness.

So there are two questions

1. Is LLMs really showing intelligent behavior. 2. Is that real intelligence.

I think even to the first question, the answer is no. Because really intelligent behavior that can solve complex math problems should be also be able to do basic things like counting, without any extra mechanisms. Intelligent behavior would understand low level things, and building understanding of higher level things using them. When an entity shows "understanding of higher level things, without showing an understanding of some of the low level things involved, then it becomes clear that the entity is not intelligent.

So this should be proof enough to identify that LLMs does not in fact show intelligent behavior. It is just some trick. An illusion. So we can reach this conclusions even without consider the implementation and training of LLMs, which We would only have to consider it to answer the second question, which was not required because it failed the first one.

[grebc]

>But what makes a human mind more "understanding"? Who says we're not simulating? Who says our mind even exists, in this space?

The people running the experiment.

And yes is the answer to what should be a rhetorical question.

[mojuba]

> But what makes a human mind more "understanding"?

If you view understanding as knowledge + the ability to apply it, everything falls into its place. The Chinese room can't apply the knowledge that it has, even theoretically.

[nh23423fefe]

That's not true. The Chinese room is no different than an immobile Chinese person.

Leveraging ability gets you nothing.

[mojuba]

An immobile Chinese person was once mobile and knew how to apply knowledge.

[nh23423fefe]

The immobile Chinese room was once a mobile Chinese room.

You're refutation isn't there. There isn't anything that distinguishes a Chinese room from a Chinese person. You submit Chinese text and get Chinese answers.

You say understanding only exists in humans. That's special pleading not an explanation.

[mojuba]

Ask your Chinese room what left and right means. Also: near and far, heavy and light, hot and cold. When it comes up with definitions through other concepts, ask what those things mean, etc.

[nh23423fefe]

You don't understand the thought experiment.

[2ndorderthought]

I see you have been downvoted. I also see how you can reason your way into your points of view. Let me see if I can add some points to consider.

1. Current ai models people use may be called neural networks, but they bare almost no real semblance to biological ones.

2. A complete human brain is not a compilation of all text books and internet chats. It is a nuanced technology shaped by human experiences , lived and biased by the chemistry of the human body. Human thought is not always linguistic. In the same way you do not tell your lungs to breathe every breath you can find a work of art astoundingly beautiful or a landscape to inspire you. Cleverness is one axis out of a billion to meter consciousness.

3. The human mind or consciousness stirs a lot of philosophical debate. Probably best not touched with a 10 ft poll on the Internet with strangers. I would encourage you to think about or read about human experiences, the synchronicities, and coincidences that happen between people. Especially under times of uncertainty, or blissful innovation. AI is seated backwards in the hierarchy of consciousness. That doesn't mean it's not useful but it's like comparing a water purification plant to the planets treatment of water from rain to subsurface flows and atmospheric chemistry.

Peace

[josefritzishere]

The discussion of AI "consciousness" always recedes into a semantic fog. It's not alive. It's not thinking. Anthropormorphizing software does not benefit our understanding, only it's marketing. ECREE (Extraordinary claims require extraordinary evidence) There has been no evidence of consciousness, extraordinary or otherwise. Everything else is rhetorical nonsense.

[throwanem]

I say.