[voidmain]

If AGI means that AI+robotics can robustly substitute for human labor, and robots are cheaper and faster to build than humans, then (a) anyone ruthless enough can zerg rush and defeat any nations that don't discard humans, (b) no one without a massive robot army will be needed in any way by their rulers. If this isn't a recipe for a horrific outcome, what is?

[sometimelurker]

> defeat any nations that don't discard humans

AGI doesn't do away with nuclear MAD, it just messes with economics and makes many people temporarily jobless. Temporarily because in a literal sense RLVR needs verification to train off of, and a lot of jobs cant be easily checked if theyre done. this includes AI safety people, preschool teachers, psychologists, and probably a lot more, including most of their bosses

[voidmain]

Nuclear weapons are mostly a threat to cities, and a zerg rush build would just not build any.

I think that if all we get is skill cloning for formally verifiable tasks, that is not "AGI" and does not doom us. It probably won't even doom software engineers, because their whole job is also not formally verifiable. I don't trust that the next ten trillion dollars of AI research won't give us data efficient continual learning and agency on par with humans, which is what I would call AGI.