We fought a war to end slavery. A small number of prosperous people were severely inconvenienced by society enacting that greater good.