It reasonably could be, if you are trying to undo systemic disadvantages that different groups have.
You have to make a conscious choice to accept some adjustments higher if the foundation is systematically unfair. It might feel unfair to the folks who benefit from systematic advantages early.
You're arguing that past discrimination justifies present discrimination, and that past discrimination is in fact solely or majorly responsible for present disparities in outcomes. I can't see a world in which these positions are provable in a meaningful manner and not devolve society into a bitter, recriminatory cesspit, especially when it means that some people will in fact be hurt by present discrimination.
You have to make a conscious choice to accept some adjustments higher if the foundation is systematically unfair. It might feel unfair to the folks who benefit from systematic advantages early.