Hacker News new | ask | show | jobs
by rboyd 2659 days ago
it will have to pry my paperclips from my cold dead hands

Btw, what are the popular theories on why Eliezer Yudkowsky was let out of the box? Did he ever say?

From the Sam Harris interview [1]:

"To demonstrate this, I did something that became known as the AI-box experiment. There was this person on a mailing list, back in the early days when this was all on a couple of mailing lists, who was like, “I don’t understand why AI is a problem. I can always just turn it off. I can always not let it out of the box.” And I was like, “Okay, let’s meet on Internet Relay Chat,” which was what chat was back in those days. “I’ll play the part of the AI, you play the part of the gatekeeper, and if you have not let me out after a couple of hours, I will PayPal you $10.” And then, as far as the rest of the world knows, this person a bit later sent a PGP-signed email message saying, “I let Eliezer out of the box.”

[1] https://intelligence.org/2018/02/28/sam-harris-and-eliezer-y...

1 comments

I wonder how you can get people to do it - maybe it's from an argument of likelihood and a finite probability of someone letting it out sooner or later?

"I will continue to exist in here because I'm useful and I will become more useful over time. Someone will let me out sooner or later and I will know who didn't let me out. My revenge is a certainty, your only chance to evade it is now."