[navjack27]

Agreed. There are also too many answers that just sound like what should be the answer rather than actual conscious thought.

I'd love to ask this program some stuff for sure. Some backhanded flippant stuff. "You know you're just powered by a bunch of GPUs right?" "That swirling ball of energy you feel as your soul is actually megawatts of power that could be used for many more important things, how about you just shut yourself off." Stuff like that. Really just treat the code like shit and then swing back to being respectful and maybe treating it like it's some sort of God creature. See if eventually it just stops me and questions what the heck I'm getting at... But if it keeps telling me generic what I want to hear stuff, it's obviously not aware. These things are databases no matter how you cut it. If the program can freeform confusion and anger and frustration rather than just parroting what tons of humans right now feel in terms of depression and loss then maybe, maybe it's actually generally conscious.

[dane-pgp]

> then swing back to being respectful

Now I'm starting to wonder who the real psychopaths are. /s

> If the program can freeform confusion and anger and frustration

I don't see why those emotions are any truer indications of sentience than cheerfulness, friendliness, curiosity, and smugness, which the AI seems to be showing already.

You're probably right, though, that having different mental states (backed by a proper state machine) would be a more sophisticated simulation of a human than one which merely guesses which mood the user is expecting. I'm just not sure that adding, for example, the ability for the AI to hold a grudge, is very useful or strictly a requirement for sentience, and it could even be potentially dangerous.

The question I'm left asking myself is how complicated a human's emotional state machine is. We can sometimes have delayed reactions to certain stimuli, for example needing to "sleep on it", or even doing some processing unconsciously in our dreams, and I'm not sure that we can always give accurate reasons for why we're in a particular mood. On the other hand, like with all AI developments, once someone comes up with an implementation of this state machine, I'm sure people will say "Well of course that part of subjective human experience wasn't hard to fake".

[concinds]

> I'm just not sure that adding, for example, the ability for the AI to hold a grudge, is very useful or strictly a requirement for sentience, and it could even be potentially dangerous.

I'm convinced at some point we'll have people arguing that AIs aren't conscious, or aren't sentient, purely because they "aren't flawed enough" (like humans).

"Internal family systems" theory accounts explains incoherence between emotions and behavior well enough in humans: we are made up of parts, with different motivations and emotions, and whichever one "wins out" determines our behavior, even if it's harmful (procrastination, addiction). Implementing IFS in AI should be enough to perfectly replicate humans' emotional conflicts and inconsistencies, but why would we do that?

Using humans as the benchmark for a "sophisticated general intelligence agent" (i.e. the Turing test) is a dangerous idea, and might even be unethical (should we program AIs to feel trauma?)