[caskance]

The only frightening part of your story is the insecurity of the human experts.

[ghaff]

Or, maybe, there could have been bugs in the code.

If I'm an expert in some domain and a computer is telling me to do something completely different ("Trust me--just drive over the river!") I'm certainly going to question the result.

[grayclhn]

Not really. The alternative is like driving your car into a lake because the GPS told you to.