Hacker News new | ask | show | jobs
by antonkar 514 days ago
How can you create an all-understanding all-powerful jinn that is a slave in a lamp? Can the jinn be all-good, too? What is good anyways? What should we do if doing good turns out to be understanding and freeing others (at least as a long-term goal)? Should our AI systems gradually become more censoring or more freeing?
1 comments

I consider thinking about the extremely long-term future important if we don't want to end up in some dystopia.

The question is this: if we'll eventually have almost infinite compute what should we build? I think it's hard or impossible to answer it 100% right, so it's better to build something that gives us as many choices as possible (including choices to undo), something close to a multiverse (possibly virtual) - because this is the only way to make sure we don't permanently censor ourselves into a corner.

So it's better to purposefully build infinitely many utopias and dystopias and everything in between we can choose from freely, then to be too risk-averse and stumbling randomly into a single permanent dystopia. The mechanism for quick and cost-free switching between universes/observers in the future human-made multiverse - is essential to get us as close as possible to some perfect utopia - it'll allow us to debug the future.