[schoen]

I think the people you're responding to are taking the modus ponens for your modus tollens, saying that interpersonal utility comparisons are not obviously possible or meaningful, and so aggregating utilities across persons is also not obviously possible or meaningful.