Hacker News new | ask | show | jobs
by supern0va 12 days ago
Funny enough, the models seemingly go insane and decohere into noise output in the absence of sensory input, which is remarkably similar to what would happen to a human.

That said, I'm not sure I follow what you're actually asking here? I'll also note that I'm not taking a position one way or the other, just sharing a podcast and noting that an extremely reputable scholar on the subject of consciousness seems to have a bit more uncertainty and humility than many commenting here. ;)
1 comments
slashdave 12 days ago
LLMs just wait for a prompt, so they do nothing and are just frozen in place.

I'll find time to listen to your link, it sounds interesting. My objection is the strange idea that humans are automatons that are keyed off input like a clockwork machine and operate sequentially. This is clearly not the case.

link
supern0va 12 days ago
>LLMs just wait for a prompt, so they do nothing and are just frozen in place.

I'm not sure that's a compelling argument. Humans can be put into a similar state where they are unconscious and not thinking. Think of someone in a coma, for example, where we actually measure and confirm that there is no brain activity where they're in that state.

They are not actively conscious, but that doesn't nullify their consciousness from when they were awake, right?

>My objection is the strange idea that humans are automatons that are keyed off input like a clockwork machine and operate sequentially. This is clearly not the case.

Well, a few thoughts here. First, it's worth noting that the argument isn't necessarily that AI are conscious in the way that humans are, nor that humans are strictly automatons.

But I think the more interesting thing is that our understanding about consciousness has evolved quite a bit in just the last fifty to one hundred years. We used to think that only humans were conscious, but assumed that primates, cows, dogs, and other mammals were just automatons. Then we started to think: okay, maybe primates are conscious. Then eventually: well, dogs also seem to have consciousness, and then rodents, etc.

This has continued such that most people in the study of consciousness think all mammals are conscious, and the debate is shifting down to insects and other creatures that we do think/have thought of more as automatons. We don't actually know where to draw the line, because it's essentially impossible to really feel/know the inner states of other living beings.

In the face of all this uncertainty, Chalmers just points out that since we understand consciousness so little, that ultimately we should probably be less definitive in pronouncing which things do or do not have it.

link
stinkbeetle 12 days ago
> I'm not sure that's a compelling argument. Humans can be put into a similar state where they are unconscious and not thinking. Think of someone in a coma, for example, where we actually measure and confirm that there is no brain activity where they're in that state.

He was responding to your comment

> Funny enough, the models seemingly go insane and decohere into noise output in the absence of sensory input

The assumption being that "sensory input" is a prompt. What did you mean by sensory input?

link
supern0va 11 days ago
>He was responding to your comment

No, I could be mistaken, but I think he was clarifying his higher up comment:

>Imagine yourself in an isolation chamber. What are you thinking? Are you no longer conscious?

link
stinkbeetle 11 days ago
Would be strange since he replied to you specifically, commenting about your post.

In any case, what do you mean by sensory input for LLMs?

link