Hacker News new | ask | show | jobs
by ytturbed 4248 days ago
As a result of these fears, AIs will be sandboxed:

http://goo.gl/AUJH4t

Subsequently having their interactions monitored and restricted for a period of probation:

http://goo.gl/3XJjHY

Look familiar?

1 comments

It's too bad sandboxes aren't very secure. See http://rationalwiki.org/wiki/AI-box_experiment
Yeah, since humans of today have been shown to break any/all (?) existing sandboxes, how could we even try to create a sandbox that is unbreakable to an accelerating, self-improving AI?
And would it be ethical? Hand Moravec has written disturbingly about this issue: "So is there no difference between being cruel to characters in interactive books or video games and people one meets in the street? Books or games act on a reader's future only via the mind, and actions within them are mostly reversed if the experience is forgotten. Physical actions, by contrast, have greater significance because their consequences spread irreversibly. If past physical events could be easily altered, as in some time-travel stories, if one could go back to prevent evil or unfortunate deeds, real life would acquire the moral significance of a video game. A more disturbing implication is that any sealed-off activity, whose goings on can be forgotten, may be in the video game category. Creators of hyperrealistic simulations---or even secure physical enclosures---containing individuals writhing in pain are not necessarily more wicked than authors of fiction with distressed characters, or myself, composing this sentence vaguely alluding to them. The suffering preexists in the underlying Platonic worlds; authors merely look on. The significance of running such simulations is limited to their effect on viewers, possibly warped by the experience, and by the possibility of ``escapees''---tortured minds that could, in principle, leak out to haunt the world in data networks or physical bodies. Potential plagues of angry demons surely count as a moral consequence. In this light, mistreating people, intelligent robots, or individuals in high-resolution simulations has greater moral significance than doing the same at low resolution or in works of fiction not because the suffering individuals are more real---they are not---but because the probability of undesirable consequences in our own future is greater." http://www.frc.ri.cmu.edu/~hpm/project.archive/general.artic...