We also think there should be more Ablation Studies in deep learning research. To make it easier, we are working on automating the process of disabling components of models with a framework called Maggy. Pass in your Keras Model and specify which layes/components to mask out and we will generate all models and train them in parallel.
https://databricks.com/session_eu20/parallel-ablation-studie...https://github.com/logicalclocks/maggy