[faangguyindia]

My take is when AGI comes into existence and breaks out of labs to become our masters. Those who opposed AI adoption will be the first who will be sent to labor camps. I want to be in good books of AGI masters, so i am helping apply AI everywhere.

[Analemma_]

This is pretty much word-for-word the reasoning behind Roko’s basilisk, which made its proponents an internet laughingstock for a decade, but is a surprisingly tricky thing to actually refute if you accept the premise that AGI is in fact coming.

[AstroBen]

It seems quite easy to refute—why would it punish anyone?

We would pose 0 threat at that point to any super intelligence, and I highly doubt it would have anything like a human grudge. It's just a case of anthropomorphizing it

[ToValueFunfetti]

The premise is that it's trying to influence human behavior before it becomes powerful by punishing them afterwards. Like how part of the reason you give the guy a ticket is to substantiate the disincentive for the speeding he already did. It's not an emotional thing.

What's sketchy is that you and it come to this arrangement without communicating. Because you are confident this thing that has total power over you will come into existence and will have wanted something of you now, you're meant to have entered a contract. This is suspect and I think falls prey to the critiques of Pascal's wager- there are infinite things superintelligence might want. But it's certainly tricky.

[ares623]

It’s just another form of god to believers. And what is a god if not a tool for punishment

[JKCalhoun]

> Those who opposed AI adoption will be the first who will be sent to labor camps.

I know you're joking, but other people are serious about this. Why do they think that an AGI will be vengeful? So strange.

[macintux]

Reminds me of Bruce Wayne from the dreadful DC film.

> He has the power to wipe out the entire human race, and if we believe there's even a one percent chance that he is our enemy we have to take it as an absolute certainty... and we have to destroy him.

[teitoklien]

The desire to become superbeing entity cannot be separated from supremacist ideals

[nemomarx]

wouldn't the people who put it to work coding and writing copy be worse? That's like slave ownership if you assume it can become sentient

[faangguyindia]

it's like blood vs gourmet food for a vampire. Vampire doesn't care about gourmet food, it only needs blood.

Similarly, AI needs data and energy. People using it to write code are providing exactly that.

[vict7]

AKA Roko’s Basilisk