[seydor]

DL did not take 'direct inspiration' from neurosciences. Maybe some ideas were borrowed such as the integrate-and-fire nature of neurons and Hebb's very vague rule, but those are very old ideas. Most of neuroscience research in past decades is in molecular biology , and particularly in the study of neural diseases (that's where all the funding goes). Learning and biological plasticity is notoriously complex and difficult to study, it's still very much undeciphered, and none of that plasticity research has made its way into ANN training.

In fact it is the reverse: the recent success of deep learning has sparked a race in neuroscience to try to find processes in the nervous that might mimic deep learning and in particular to build biologically plausible models about how the brain might implement gradient descent or more generally credit assignment.