Could the AI actually see the race of the applicants? Or was it just discriminating on the basis of some factor it found that was correlated with race, like SAT scores?
> discriminating on the basis of some factor it found that was correlated with race, like SAT scores
Hypothetical SAT score: 1060
How does that help you predict the race of an individual applicant? It's been a while since I took the SAT, but I didn't realize one's score provided so much information.
It rejected Asians more because of their higher SAT scores? If it’s not directly based on applicants disclosing their ethnicity then probably something more obvious like names.
I'm going to assume that people aren't allowed to put "don't send me black applicants" into their process even if they do see race in the application as that's entirely illegal.
The paper's conclusion, that we need to study this more, is showing the authors likely believe this to be a byproduct of inherent/invisible bias.
Hypothetical SAT score: 1060
How does that help you predict the race of an individual applicant? It's been a while since I took the SAT, but I didn't realize one's score provided so much information.