[titzer]

The even scarier scenario is:

0) AI "becomes self-aware," hides

1) US military builds up arsenal of autonomous killing machines and nuclear missiles

2) US military connects all of these to the Internet

3) AI by default has control of these

4) AI wipes out humanity in massive, overwhelming strike

[chriswarbo]

Again, I don't think that's scarier, since step 0 is a) pretty meaningless and b) completely unnecessary. Our technology is capable of so much destruction (intensional or inadvertent) that it doesn't make much difference whether a human pushes the button or the button pushes itself; least of all whether the self-pushing button is "aware" that it's pushing itself.

[adenozin]

Yeah, our weapons are really destructive now, but AI like that won't have mercy. If any nation fires nukes and nuclear war starts there is no way in practice all of the human race will wiped out, in theory yeah and then it doesn'matter who fired them, but that is only in theory.