|
|
|
|
|
by whimsicalism
807 days ago
|
|
My experience working in machine learning academia is an overfocus on failed projects from the early 00s to 90s that really only stopped in 2020+. We can often trace back successful projects to failed precursors, but often the people behind the successful project are not even familiar with the failed precursor and the 'connection to the past' only really occurs in retrospect. See the 'adjoint state method' and connections with backprop. |
|
Once the dust has settled, there are often much clearer through lines than in looked like at the time. It's hard to see when you are on the moving front though.