The right comparison is "For people who can spend $500 on a pair of pants, what is the financial difference between $100 and $500?"
For most of that subpopulation, not much.