We've been discussing, debating, and voting about taxes and wealth distribution for hundreds of years. If the solution were so simple, wouldn't you expect the problem to be solved by now?
So the OP says what society decides isn't fair, and you say that fairness is decided by society. It seems like there should be a less paradoxical way to reason about this.