[BizarroLand]

I don't know how I would feel about allowing AI to put humans in prison without incontrovertible proof.

Any black box thing, (that is, any system where raw data comes in and a result comes out without everyone involved fully understanding the process) should not have the authority to take a human's freedom from them of its own volition.

I would much rather utilize them as a Sherlock whose job is to assemble the evidence that is available and state their conclusions to the jury, who could then make their decision based off of the evidence.