[tarsinge]

I'm not in the field but I think it's because historically neural nets were looked down and deemed unpromising because they lacked understanding, compared to Symbolic AI or SVM for example. Since the Deep Learning revolution, which is engineering driven, the trend has inverted, research to understand and theory are seen as the things that hindered progress with neural nets in the past.

[jmalicki]

Part of the issue with neural nets is that historically they were next to impossible to train. ADAM, BatchNorm/LayerNorm, initialization schemes, and GPUs for pure speed really helped to change all of that.