Is there some kind of asymmetry that prevents this logic from being applied with "older" replaced by other inherent physical attributes like race, or do you think that wouldn't be discrimination either?
Maybe the fact that everyone becomes old, whereas with other protected classes, everyone does not eventually gain membership into that class. So society as a whole is more sympathetic to discrimination that favors the older maybe because we can see ourselves in their shoes.