Hacker News new | ask | show | jobs
by mklim 3448 days ago
>Put another way, there’s a risk of AIs learning to achieve their assigned task better by preventing humans from shutting them down.

Thought experiment/short story that goes into this in depth: https://gist.github.com/deanmarano/142df7a8a824ab05fc777d8e0...

The crux of the story hinges on the magical spontaneous development of general intelligence, so it's pretty unconvincing as a specific plausible scenario IMO. But the general idea, that an AI may take unethical/unprecedented actions to maximize a harmless goal, is a good one.