[thomaslkjeldsen]

This reminds me of dropout regularization where you improve a neural network by removing random neurons from the neural network.

See https://en.wikipedia.org/wiki/Dropout_(neural_networks) and https://youtu.be/u4alGiomYP4?t=33m53s

[98Windows]

Dropout is only used during training a neural network and also neurons are turned off not removed.

[luckystarr]

Well, the brain is constantly trained and used. :)