[rsa25519]

> But it brings up questions for the future - what happens when AI is wrong but used as proof of something?

You bring up a fair point, but I don't think AI is special in this regard. Imperfect sources of information synthesis (humans, naive algorithms, etc) are used all the time. Hopefully, AI should simply add one more data point from which to understand a given situation.

[lvturner]

People, presently seem much less willing to challenge what a computer says however.

I'm wondering if Little Britain's "computer says no"[1] sketch is somewhat foreshadowing here. It's certainly a situation I've ran in to in several banks (globally).

[1] https://www.youtube.com/watch?v=0n_Ty_72Qds