Hacker News new | ask | show | jobs
by kypro 940 days ago
> humans created AI and will debug it & turn it back on if anything bad happens to it

I think this is a little naive honestly. One because you're assuming AI will care about it's creators like humans care about their parents, and two you're assuming AI cares about being "turned back on" like humans have a desire to live.

There's absolutely no reason to believe an AI will give a damn about its creator beyond its ability to use that creators affection for it for its own gain.

1 comments

> you're assuming AI cares about being "turned back on" like humans have a desire to live.

> for it for its own gain

you seem confused

almost any kind of "its own gain" requires "long-term planning" which pretty much requires the agent to prioritise staying "alive" (i.e. being able to keep playing)