[felipemnoa]

Inventing/Discovering Strong AI will be one of the greatest achievements of all time in my opinion. It will change our world in ways unimaginable. Our standard of living will go up for everybody, even the poorest nations. I just hope that we don't manage to kill ourselves with that technology.

How could we kill ourselves with such technology? Simple, the government will probably weaponize AI, build robots with it. An agent somewhere will issue a command to "eliminate such and such", the robot will understand it as eliminate humanity because of a bug in its system. Due to bad luck the safeguards that are to prevent this also fail. i.e. This would be like a cascading failure that brings down airplanes.

Upon receiving its orders the first thing the robot will do is that it goes into hiding, it replicates itself as much as possible while remaining undetected. Several decades letters all of its descendants detonate all of the world's nuclear arsenal along with the new ones they've built. Mission accomplished. (I think this is the plot for my first SciFi book!)