Really cool ideas going around in this thread. I really like thoughts around visualizing the changes during training -- not just activation.
As these tools currently stand, I agree that they are mostly for educational purposes. Taken to the nth degree, however, I think they can make a DL expert put on a VR headset when they get to work.