[darkmighty]

Meh. Competitive race to dehumanization, ruthless proggressivism, are not physical laws. If there are sufficiently many actors unwilling to make accords, sure, it's inevitable. But there is enough structure and organizations, and interested humans, such that we can alter society to give a little more weight to basic human values than surrender to the endless march of domination.

We needn't halt it -- after all, if we can create a good desirable society, a billion more societies would be welcome.

But we have, and should continue to, what's truly valuable and worthwhile to pursue. An universe filled with automatons (even if scientific or mathematics god-like savants) is boring -- and I love mathematics -- but in general problem-solving ability is certainly not the whole story of cognitive experience, even general problem-solving ability. The life experience of Lee Sedol is more interesting than the synthetic "experience" of AlphaGo, even if it is superior at his life's work. If we had an AGI strictly geared towards solving technological problems the same might be said, even if ultimately other aspects of human experience are "wasteful", unnecessary for conquest and dominion.