[hax0ron3]

The distinction between intelligence and consciousness has been discussed in philosophy of mind for many decades, perhaps centuries. I don't know much much it has been discussed in the context of LLMs, but I'm sure it's not an entirely new phenomenon. The debate is not just a matter of people trying to argue over how capable LLMs are. Many people pursue this topic because it is inherently interesting.

[FrustratedMonky]

I think even in philosophy of mind, Intelligence and Consciousness are seen to progress together. They follow the same trend, and at some magic point of enough intelligence, then we call it 'consciousness'. They follow same upward trend.

This concept of having high intelligence that is not-conscious, or low-intelligence that is conscious. Seems relatively new.

[thfuran]

Go read Blindsight.

[FrustratedMonky]

Finished it just few weeks ago.

And it did a lot to change my mind. I'm still digesting it.

Before blindsight, I was firmly of opinion that any system that could be at least human level (lets say indistinguishable), then it would also have to have some internal subjective experience. That the internal subjective experience would be another emergent phenomenon. As NN is processing, it would have the same internal awareness as a human brain.

But, after reading blindsight. I am questioning that.

So can we get automatons, that have no thought, but could also become greater than humans? With enough complexity in responses, can they adapt just as easily to new situations.

I'm not really ready to think that is possible.