Hacker News new | ask | show | jobs
by scaphandre 4879 days ago
Do you have any proof that Strong AI would be safe for humans?
2 comments

The default outcome for AGI is likely bad (http://singularity.org/files/ComplexValues.pdf and http://singularity.org/files/SaME.pdf), but not in the ridiculous way that movies portray it, and no one should be using the movies as a substitute for thought (http://lesswrong.com/lw/k9/the_logical_fallacy_of_generaliza...). There are so many types of AI minds, and so many ways for it to go wrong (http://wiki.lesswrong.com/wiki/Paperclip_maximizer) that picking out a very particular fictional one to stress over, make movies about, and attempt to constrain (even framing it as a constraint problem of some more "primitive" desire to destroy humanity) as the only default mind, is pretty silly.
Not sure why this being downvoted. Provably friendly strong AI is actually sth that researcher care about, yet it is difficult to do because "friendly" has to be defined.