[SolaceQuantum]

The presumed argument here is that you can challenge individual people, corporations, etc. more easily on discriminatory behavior than you can challenge an algorithm. If an algorithm happens to refuse to issue loans to black people, who's the class action lawsuit going to sue?

[CamTin]

Presumably you could sue the bank that is using the AI to make the loan decisions, or is there something I'm missing?

[AlexandrB]

You'd have to prove that the A.I. was discriminating based on a "protected class" and not on some other basis. But you have no insight into the A.I. or its training data. Nor do you have a comparable A.I. of your own to run A/B experiments that can prove discrimination. Now what?

[CamTin]

Don't these problems already arise when trying to prove bias in a legacy meat-based intelligence?

[AlexandrB]

There's an additional danger. Many times society moves forward when the standard-bearers for what was "acceptable" or "correct" before retire or die out. A.I. doesn't die. An A.I. constructed with today's biases may, in some form, outlive its creators and carry these biases well into the future.

"Science progresses one funeral at a time." -- Max Planck