[laretluval]

Maybe our primate brains are primitive, or maybe they are infected with a kind of disease that will result in the eradication of our species. Certainly if we observed self-extinctive behavior in the wild, we would classify it as a behavioral anomaly and perhaps even try to fix it, like we do with the pandas who refuse to reproduce.

But more generally, of the two ways of seeing it, who's to say which is right? When we disagree, to what can you appeal?

My point is, these moral questions are completely arbitrary. There is no grand cosmic objective function for life that is objectively true. Using these quasi-religious arguments about the "purpose of life" to guide AI safety research seems extremely irresponsible.