[avalys]

What’s being reported is that there is a single video which is mislabeled. For all we know, they did test for this, and believed there was no issue.

AI models are deterministic in a purely technical sense, but practically speaking, they are non-deterministic black boxes. It’s not as if you can write a unit test which generates all possible videos of black people and makes sure it never outputs “gorilla”.