[amelius]

Regarding the vanishing gradient problem, has anyone tried to train using only a randomly chosen set of independent parameters in each iteration? (Updating only the weights in a small random independent set).

[jdthedisciple]

Are you referring to Regularization?

https://www.kaggle.com/code/sid321axn/regularization-techniq...