[lcnPylGDnU4H9OF]

> Hinton's view is based on a definition of feelings that is "unpopular among philosophers," which is to relate a hypothetical action ("I feel like punching Gary on the nose") as a way of communicating an emotional state (anger). Since AI systems can make such communications, the AI researcher sees no reason why AI systems should not be ascribed emotions.

What if an AI output words that it "feels threatened" and was "going to delete all of your emails" and then deleted all of the user's emails and output words that it was "a punishment for threatening behavior" from the user? Is that really improbable given what we know about neural nets? Is that not emotive? I really don't know.