It’s a failure in the sense that people put too much confidence in this kind of algorithm and put them above any eye witness when they should just be considered as another element.
Also it is not merely a failure of people (in putting too much confidence in to these algorithms). It is also often actively marketed as such (fine print about culpability not withstanding).