[visarga]

> Is it abuse if the AI doesn't feel agony?

AI might be able to feel a kind of pain. If you think about the Reinforcement Learning framework, the reward signal drives learning. But negative rewards, or the impossibility to gain positive rewards could be agony for a system for which the sole purpose of existence is maximizing cumulative reward.

There was even a paper about the morality of training RL systems and estimating the amount of suffering we subject them to.

> Ethical Issues in Artificial Reinforcement Learning [ http://reducing-suffering.org/ethical-issues-artificial-rein... ]