| "we would be seeing private companies or governments use it internally " What world are you living in, where this isn't happening? Every private company that can use it is using it, Microsoft themselves must be using Copilot. Governments are lining up to train their own LLMs. Commercial and consumer use are not mutually exclusive, in any case. Also "Humanity is excellent at oppressing others, and I have no doubt we'd be equally good at oppressing a true AI as well." If you actually read history a bit carefully, you'd understand this frequently works out badly for the oppressors. The Romans hired, and abused their germanic mercenaries, thinking with their centuries of political experience, they could let the Germanics do all the hard fighting while getting paid little. The contemporary Jin dynasty in China thought the same way, just hire barbarian mercenaries to do all the hard work in their civil wars. Those illiterate barbarians, who up that point, have never achieved much in China, surely wouldn't be a threat. It ended very badly for both of those polities. |