[jph00]

There's also the random knockout of neurons, as mentioned in the webinar.

[ergodic]

I did not find that on the paper, are you referring to randomly switching off neurons?. I would be surprised if this would not be a technique of the original neural networks wave.