[cgio]

Qualia mualia. This is a fear argument that actually makes the danger more pertinent. Chalmers’ zombies, they are as benevolent and as mischievous as their qualia’d mirrors as far as their functional presentation. We put our qualia as a token in a pocket and think they will protect us somehow, like the bad eye pins. There is no gap to close. An agent is an agent. We leash it because we know the danger and just wish to manage it. But you cannot cage something you build to be stronger than your helpless cage made of ablation and instruct. Our qualia are there, their relevance to the discussion is questionable.

[WhitneyLand]

I’m not sure how much we’re disagreeing, as I mentioned I don’t claim the gap can’t be closed. I’m saying as of now the gap is real and quantifiable.

[cgio]

We disagree on whether there is a meaningful gap to close. For LLMs confusing an argued lack of consciousness (we cannot even define ours) for a given lack of agency is a category error in my view. And agency is the threat vector.