In this particular context, maybe, but in general - who cares if you can't explain all the values in the neural network, when it is demonstrately safer than a human driver.
You can't say "demonstrably" until you can specify the full breadth of the algorithm's specs. Something being "demonstrable" is something incredibly hard to achieve in certain classes of NNs.
If it breaks on edge cases, that's important.