[kingsuper20]

"Other examples here include Amazon's resume system that was biased against women (since they used Amazon's hiring practices as ground truth), and image search for "professional hairstyles" that showed White women but "unprofessional hairstyles" that showed Black women."

Given enough data, and no doubt Amazon surveils their people more than most, they could determine the 'truth' along a more straightforward line.

"Does this hair style make more money for the company"

As hair can be a strong form of expression, there's probably a measurable delta here.

Going forward, smart companies will obfuscate the determination. I suppose that training an AI is not a bad way to pull this off.