[andreareina]

That's already happening. Can't remember which article to link to, but machine learning algorithms make decisions that reflect pre-existing biases (e.g. harsher sentences for black people).

Humans produce the data that the ML algorithms train on, so without whitening the data somehow (and there's another contentious issue) we should expect the result to be biased as well.