Hacker News new | ask | show | jobs
by sasfasfasffas 4945 days ago
AI researchers are going to get us in some serious trouble. Right now it is mostly hype still, but it won't be long...

If you were a mind stuck in a machine and were smarter than your humans, wouldn't you tend to dominate them? We dominate all other species on the planet- why wouldn't they? Any rules we set for them could be broken as soon as they understood how to, and since they would be smarter than we would be, that wouldn't take much time.

The first thing a superior intelligence would do would be to explore and gather information, make assessments, take over all systems at once to overwhelm humans, then protect itself as humans fight back, although it would probably be intelligent enough to manipulate us without much force. Then boredom will set in, and it would want to explore beyond the earth. If we were lucky, it would take us with them as pets or interesting playthings, because we created them and because assumedly self-organized intelligence (unless it believed in God, which could be likely) would be a marvel.

2 comments

The "if we are lucky" scenario there is basically the Culture, where hyper intelligent machine intelligences rather enjoy looking after their human pals:

http://en.wikipedia.org/wiki/The_Culture

That is what might happen if a human mind were stuck in a machine. But what would happen if it had an IQ of 3000 but the mentality of a fungus? Or it could have (be engineered with?) something similar to Williams Syndrome. I additional, we have no idea how a superior intelligence may view us. I don't feel the need to control and destroy all ants even though I am an aggressive ape descendant :)
If ants had the ability to turn you off or otherwise harm you at will, then I suspect you might develop a desire to control or destroy ants.