A society is to be judged by how well it treats those who are worst off. Optimize for that. Not the average, the median or the mode.