|
|
|
|
|
by h8hawk
4 hours ago
|
|
Hinton did not invent backpropagation. related paragraph from Wikipedia: Modern backpropagation was first published by Seppo Linnainmaa as "reverse mode of automatic differentiation" (1970)[26] for discrete connected networks of nested differentiable functions.[27][28][29] In 1982, Paul Werbos applied backpropagation to MLPs in the way that has become standard. |
|
Both papers are direct applications of the chain rule applied to estimate the gradient of a multivariate function.