We don't have to consistently choose every intervention that benefits the group over some individuals, we can evaluate them one by one and pick and choose.
Even in a democracy, it’s rarely “we”, but more often “they” - an unelected bureaucracy. The democratic choices are several layers (and years) removed from direct impact.