[concinds]

> I'm just not sure that adding, for example, the ability for the AI to hold a grudge, is very useful or strictly a requirement for sentience, and it could even be potentially dangerous.

I'm convinced at some point we'll have people arguing that AIs aren't conscious, or aren't sentient, purely because they "aren't flawed enough" (like humans).

"Internal family systems" theory accounts explains incoherence between emotions and behavior well enough in humans: we are made up of parts, with different motivations and emotions, and whichever one "wins out" determines our behavior, even if it's harmful (procrastination, addiction). Implementing IFS in AI should be enough to perfectly replicate humans' emotional conflicts and inconsistencies, but why would we do that?

Using humans as the benchmark for a "sophisticated general intelligence agent" (i.e. the Turing test) is a dangerous idea, and might even be unethical (should we program AIs to feel trauma?)