[obi1one]

I don't think a benevolent AI is impossible, or even unlikely, but I do think that as soon as the benevolent AI exists, there are a lot of people who will work very hard to find a way to exploit the tech for military purposes. So to me, the bad scenarios are essentially inevitable, even if the good scenario comes about.

That doesn't mean that the bad scenarios are as bad as people make out, but whether the AI is itself seeking to destroy humanity or just being used by militaristic people to plan simultaneous preemptive wars against everyone they see as a threat, the technology looks very dangerous to me. We will try to build it, that is just the human way, but like with the creation of other dangerous tech, we should be thinking about the dangers and how we will cope with them.

[fweespeech]

The idea that a hostile Super-AI will take over and/or be a Doomsday scenarios is equally plausible the reverse will be equally irreversible.

A benevolent AI would immediately prioritize:

A) Eliminating hostile AI research

B) Advancing the good of humanity on the metrics it was given.