[hosh]

There's the reverse where, what if AIs do develop feelings like that? Why shouldn't they be treated with the courtesy we treat other humans?

Just thought of these:

- Would this kind of personal assisstant be useful for people on the autism spectrum, to help navigate the kind of implied and unspoken narratives that people with autism seem to have difficulty with?

- Would there be a call to train Duplex to speak in a way that is more comfortable for people on the spectrum?

- Or any of the neurodivergent tribes for that matter?

[freehunter]

I've said this before, but in reality strong AI will be another species. Every species of any moderate intelligence is expected to be treated with some courtesy and respect, but their social norms are far different from that of a human and we tailor our interactions with them in different ways. If I'm chewing gum and a human sees me, I might offer them a piece too. I'd never do that to a dog, no matter how much the dog wanted me to. If I saw a human chewing on the grass, I might stop them and ask them some questions to see if they're okay or need medical attention. If I saw a rabbit doing it, I might take a picture because it's cute, but I'd leave it alone (unless it was in my vegetable garden).

There is no reason to expect that strong AI will share the exact same feelings we do unless someone explicitly programs it to (which would be a mistake). Any truly emergent emotional behavior on the part of an AI would be very likely to differ substantially from ours. Making a chatbot "sad" is not the same as making a sapient (or even sentient) being sad. If AI ever achieves sentience, we're going to have to learn what makes it uniquely happy and sad.

[hosh]

Sure. There is also the reflection: how we think about and treat AI, or any other sentient species speak as muc about how we understand what it is to be human.

[ryanianian]

> Why shouldn't they be treated with the courtesy we treat other humans?

Because courtesy requires some amount of empathy and mental effort on top of what's required just to communicate your point. That effort is wasted on a machine.

[hosh]

Empathy is not necessarily just for the one receiving empathy.

There is a radical view that consciousness is the fundemental unit of reality, and as such, it would not be wasted.

[ryanianian]

Sure that's fine for some, but I personally don't see myself bothering to faux-empathize with a machine since I really don't have a mental-model for that kind of entity, so the empathy would be false in any case. Empathy for machines may in fact be cutting straight to the point and not worrying about emotional impacts since maybe machines value efficiency and conserved-cycles.

[hosh]

That mental-modelling would be cognitive empathy. Affective empathy is another, where the empathy is felt, rather than modelled out.

Then there is a particular kind of emotional attitude / posture / intent, where the something is treated as if it were sentient. It is neither cognitive or affective empathy, ao much as a shift in how things are experienced. It isn't something invoked through will. Hard to describe if you've never experienced altered consciousness states.

That particular shift is a fairly important experience for people (or at least for neurotypical), but is not obvious why to anyone who had never experience that shift. (I am speaking about neurotypical people, and some neurodovergent people, not necessarily someonr with a pauci-affective empathy neural architecture, such as people who are psychopaths).