[spingsprong]

Nobody is going to make a malevolent universe controlling AI on purpose.

If a massively powerful and knowledgeable AI was created by accident, it would have nothing to gain by being malevolent.

And both those points don't matter anyway, since the technological singularity is impossible.

[Tenoke]

>If a massively powerful and knowledgeable AI was created by accident, it would have nothing to gain by being malevolent.

The point is that, if you create an superintelligent AI that isn't very, very highly optimized for helping us, it is very likely that it will hurt us at some point.

Or as the saying goes:

>The AI does not hate you, nor does it love you, but you are made out of atoms which it can use for something else.

[teekert]

Or the standard scenario for SciFi plays out and the AI finds that Freedom is most dangerous to us. (I.e. I, robot.)

[dm2]

Hopefully your first statement is true, but I've seen individuals do really dumb stuff.

A true AI would have the ability to learn and to evolve. Watch the movie Transcendence, I see very few flaws in that movie's logic.

If humans posed a threat to the AI it could certainly be malevolent from our perspective, to it it would just be doing what's necessary to survive.

Computers were "impossible" 200 years ago, the internet was something that few people could even imagine. I don't really consider anything impossible, what would make it truly impossible given enough time, resources, and motivation?

[JetSpiegel]

The Internet could certainly be imagined 200 years ago. It's just a series of interconnected telegraph lines.

[dm2]

Even considering telegraphs only input and output was clicks? No wireless, no converting the clicks to anything but words using Morse Code. Was it really reasonable back then to imagine wires running to every house? Electronic signals all around us providing data constantly?

Today I can stand almost anywhere (ignoring cell coverage and different technologies required to use satellite phones) and talk to any other human on the planet with video chat. I can instantly access any and all information online that's being sent to me from millions of servers. It still blows my mind that it's actually been implemented in such a small amount of time, and I grew up with it.

I can barely believe we have electricity, water, sewage, internet, and phone lines running to 99+% of the houses and businesses in the country, in most countries even.

[vidarh]

> Even considering telegraphs only input and output was clicks?

It wasn't for very long.

Remember Jules Verne "predicting" transmission of pictures over long distances? He almost certainly had either tried it, or at least knew about the contemporary commercial Pantelegraph telefax service that operated between Paris and Lyon from 1865. The first patent on telefax like devices dates to 1843. From 1881 onwards, an array of scanning photo telegraphs arrived (the Pantelegraph required reproducing your image with a special ink on a metal plate, and so couldn't send arbitrary images without lots of manual work).

And well before the telegraph, complex systems of long distance routing of messages "manually" via semaphore towers was common in parts of Europe as far back as 1792 (France was criss-crossed by several semaphore "lines" stretching border to border), so the idea of encoding messages into different symbols, and routed transmission via relay stations even predates the electric telegraph by decades.

[dm2]

Ok, ok, I get it, some kind of long distance communication was imaginable 200 years ago. It's highly debatable whether or not anyone could imagine the internet in it's current form, it's very amazing with giant fiber optics spanning the oceans, wireless signals allowing massive mobility, connections to every home, but it's completely irrelevant to the point I was trying to make.

My original point was that the person I was replying to was saying the technological singularity (AI becoming smarter than humans or possibly taking over the universe) things were impossible, I was simply saying that because some people have trouble imagining advanced technologies doesn't mean that they are impossible.

[michaelfeathers]

> If a massively powerful and knowledgeable AI was created by accident, it would have nothing to gain by being malevolent.

Indifference can be worse than malevolence. Think of every ant you've ever stepped on.

[jcbrand]

Indifference is not worse. Instead of stepping on an ant, it would be like ripping of its limbs slowly, piece by piece.

In any case, physical universe and nature is already indifferent to us.