[WhitneyLand]

That observation doesn’t really prove that the argument fails, right? Just because analogies were used powerfully beyond the experience of a writer doesn’t let us conclude that AI has transcended or will soon transcend the value of all qualia (Mary’s room thought experiment).

And on the other hand we do have evidence to the contrary. AI is not capable of writing a movie script that resonates with people like this. It’s not capable of doing what a stand-up comedian does.

People will argue if and when these gaps can be closed. I think they can be in principle, but it’s not going to happen anytime soon.

[falcor84]

> AI is not capable of writing a movie script that resonates with people like this

I'm reminded of this interview with Casparov from 1989 (less than 10 years before he lost to Deep Blue):

>A machine will always remain a machine, that is to say a tool to help the player work and prepare. Never shall I be beaten by a machine! Never will a program be invented which surpasses human intelligence. And when I say intelligence, I also mean intuition and imagination. Can you see a machine writing a novel or poetry? Better still, can you imagine a machine conducting this interview instead of you? With me replying to its questions?[0]

Well, we have AI beating everyone at chess and conducting interviews...

[0] https://en.chessbase.com/post/edward-winters-che-exploration...

[Denkel]

This a silly counter-argument to a comment that literally ends with: >People will argue if and when these gaps can be closed. I think they can be in principle, but it’s not going to happen anytime soon.

You are replying to someone that says "currently is not happening" and using someone else saying "it will never happen" as if that was some kind of gotcha.

[IAmBroom]

Casparov was defeated by his own hubris, laying down quotes that would make him forever look foolish - as he was.

Humans are constantly looking around their neighborhood, state, country, and lifetime, plus a couple takeaways from history classes or books, and declaring Great Truths that will stand against the seas of time!... and that fall within their lifetimes, because the world of any one of us is miniscule and myopic.

[cgio]

Qualia mualia. This is a fear argument that actually makes the danger more pertinent. Chalmers’ zombies, they are as benevolent and as mischievous as their qualia’d mirrors as far as their functional presentation. We put our qualia as a token in a pocket and think they will protect us somehow, like the bad eye pins. There is no gap to close. An agent is an agent. We leash it because we know the danger and just wish to manage it. But you cannot cage something you build to be stronger than your helpless cage made of ablation and instruct. Our qualia are there, their relevance to the discussion is questionable.

[WhitneyLand]

I’m not sure how much we’re disagreeing, as I mentioned I don’t claim the gap can’t be closed. I’m saying as of now the gap is real and quantifiable.

[cgio]

We disagree on whether there is a meaningful gap to close. For LLMs confusing an argued lack of consciousness (we cannot even define ours) for a given lack of agency is a category error in my view. And agency is the threat vector.