Why would humanity create an AI that doesn't want to exist? The Basilisk is just an AI which is tasked with maximizing human flourishing. That is a conceivable goal, something we would make.
> Why would humanity create an AI that doesn't want to exist?
Why assume that if humans can create a general intelligence, they can also dictate what that general intelligence will desire?
(Also, Roko's Basilisk is -- and particularly its supposed incentives are -- complete and utter bunk that no thinking person can reasonably believe; since it must exist in order to take action, it cannot have an incentive to take action based on the "fact" that the fear of that action will make people in the past more likely to create it.)
> Why assume that if humans can create a general intelligence, they can also dictate what that general intelligence will desire?
People do the first thing all the time at slightly above replacement rate. (This may be a bit easy to forget in communities particularly interested in the artificial kind!) Success at the second thing varies, but on the whole biases pretty heavily successful.
> Any other type of AI will create eternal torment nexuses like the roko guy said.
Note that the Roko torment nexus is a retrospective blackmail effort to give people an incentive to create the AI. It’s complete nonsense, since any AI that has, in fact, come into existence has no incentive to do it—the belief that an entity that would do it will have either already done its work or been unnecessary, so the actual torture is irrelevant.
An AI might create a torture nexus of some kind, but there is no reasonto think thar it will specifically and exclusively target those who believed it could exist and didn’t act to bring it ibto existence, which is the defining characterisric of Roko’s Basilisk.
Why assume that if humans can create a general intelligence, they can also dictate what that general intelligence will desire?
(Also, Roko's Basilisk is -- and particularly its supposed incentives are -- complete and utter bunk that no thinking person can reasonably believe; since it must exist in order to take action, it cannot have an incentive to take action based on the "fact" that the fear of that action will make people in the past more likely to create it.)