[andai]

> If we’re far enough off course, increasing speed becomes counterproductive and it ends up taking longer to get where we want to be.

This reminded me of the idea that civilization is already a misaligned superintelligence, and that technology (incl. AI) just moves it faster in the wrong direction.

That's basically the problem of supermorality. If you're an actually benevolent AI, do you do what civilization tells you? Or do you do what is good? What happens if you disagree?

[abustamam]

I think it depends on what is good, and who it's good for.

Thus far, AI has been good... For venture capitalists. Jury's out if it's good for humanity and civilization at large. There have been a lot of benevolent usages of AI thus far, but also a lot of bad.

As for those who disagree with the "benevolent AI," I think they just get sent to the gallows (either metaphorically or literally)