Hacker News new | ask | show | jobs
by dialupmodem 3276 days ago
- Underground bunker construction

- Space exploration

- Anything valuable in end of the world scenarios

It's only a matter of time before someone harnesses AGI to enslave the planet and declare totalitarian rule. Perhaps even by accident.

I haven't been able to get this off of my mind lately because it's inevitable.

Physicists made nuclear things that do amazing things like power all of our refrigerators from hundreds of miles away, but have also killed thousands (Hiroshima) poisoned the environment (Fukushima, Chernobyl) and have essentially made the world a ticking time bomb.

AGI and its surrounding technologies are easily 1000x more powerful than nuclear anything, and absolutely will be abused.

4 comments

> I haven't been able to get this off of my mind lately because it's inevitable.

Google Roko's Basilisk

> AGI to enslave the planet

Why does it have to be enslave? I don't think this is a requirement.

I think it's a misconception to think that AGI can even be "infinitely" smart when compared to humans. The distinction is often made that the difference would be at least on the level of a mouse to a man. But what if it isn't?

We barely understand intelligence. There's no way we can be certain of anything here, or if AGI is even possible!

It's cool to think about, but I really doubt that anything is just a "matter of time" :)

Those items are likely only of use versus AGI in distributed form that isn't much beyond human capability.

In the face of a hard takeoff superintelligence—one that's developed a mean streak—we'd be lucky if death was even an option, let alone an escape.

Buy sub-AGI manufacturers because they will be selling the weapons that extend humanity's survival.