The trick to accurate interpretability is to decouple accuracy from explanations.
Just like an International Master commentator can explain most of the moves of a Super GM, so can an interpretable simple model explain the predictions of a very complex black box model.
The work by Caruana referenced in this article actually culminated in a method to get both very accurate models and still retain interpretability.