[insane_dreamer]

Maddening.

This will happen more often in many domains, and it raises the general question of liability.

Should it be the AI company that created the model? The company that build the face recognition software using the model? The police department that decided to use the face recognition software?

I would assume the police department is the one legally liable, though they may turn around and sue the software company, and I guess the question is whether they can sue the frontier model company.

[FpUser]

In this particular case false AI identification was only small part of generic fuckup. Choosing guy from line-up done in completely racially biased way, prosecutor office refusing proof of crime has been committed by someone else, etc. etc. The only way this ever going to be fixed is when our fucking overlords will be held personally responsible which is never.