[jqpabc123]

Understanding the patterns and why the model behaves like this is useful so it can be improved.

The answer to why is simple and obvious --- the model is probabilistic. Improving it substantially would necessitate a total redesign.

I don't think you can discredit the entire technology because it's not 100% perfect.

So dice rolling as a decision making tool shouldn't be discredited in your opinion?

Would you fly on a plane designed using similar "technology"? Anything better than double 3s says it's safe enough.

I expect the legal system to ultimately have a lot of input on the use of this. I don't expect "But AI said it was OK" is going to fly in court once people have been harmed. And once this starts happening, the enthusiasm for this "new technology" will start to wane ---after $trillions have been wasted.