Hacker News new | ask | show | jobs
by AstralStorm 3212 days ago
They don't indeed. But then, human goals do not generally go after survival of humanity directly.

A decent enough AGI with access to resources would probably figure out it is costly to wage war.

Heck, an equal probability is that an AGI will follow a bounded version of zeroth law or even nonviolence.

That is assuming it does not place value on humans based on our history of research and development. I would expect any action more akin to forced upload or upgrade instead. Anyway, at that point we might not resemble present day humans anymore.

1 comments

With an AGI thousands of times smarter than us, the fear is not that it would wage war against us. The fear is that it would wipe us out without especially noticing, in the same way we wipe out ant colonies on construction sites.