Hacker News new | ask | show | jobs
by chongli 1081 days ago
How long has it been since you studied/used university-level math? Calculus and linear algebra in particular.

I ask because it’s pretty difficult to get through the math of backprop without a firm grasp of these. The Python part is trivial by comparison, the main difficulty being the matching of dimensions.
1 comments
bob88jg 1081 days ago
It's nothing more than the chain rule...University level it is not...the engineering aspect is the non trivial part IMHO...
link
godelski 1081 days ago
While many learn calculus in high school, many also don't get it till uni. Not everyone is at your level, or took your same path, and that's okay. Don't shame people for not knowing when they're trying to learn.
link
chongli 1081 days ago
The gradient of softmax is beyond most high school calculus students.
link