Hacker News new | ask | show | jobs
by gameshot911 4947 days ago
>Should brains like this have any desires that conflict with our needs, we will be in an extraordinary amount of trouble.

Only if we equip such entities with the capacity to act on those desires.

1 comments

The brain itself is equipment enough: http://yudkowsky.net/singularity/aibox
The test was run twice and the AI was released both times but the logs of the conversations weren't made public. Also all of the extra protocols weren't in place for either test meaning he could have bought the AI's release.

It's an interesting thought experiment but it's a bit ridiculous that the "tests" are mentioned on the page when they don't have any relevance to the rest of the idea.

And why couldn't he AI buy it's own release? "Hey! I can predict the stock market for you."