|
|
|
|
|
by agibsonccc
3515 days ago
|
|
We have appendixes covering the basics there. I actually recommend deeplearningbook.org myself for a reference. The book is meant to contain simple examples oriented towards engineers building applications rather than deriving backprop. The book isnt called the definitive guide for a reason ;) |
|
In my opinion it wouldn't be too difficult or much effort to define what these mathematical objects are and show basic examples with basic computations to solidify the concepts. The notion of gradient descendent & derivates (or partial derivatives) isn't that difficult to understand and could be easily explained in a page or less.
For example when you discuss the Outer Product:
"This is known as the “tensor product” of two input vectors. We take each element of a column vector and multiply it by all of the elements in a row vector creating a new row in the resultant matrix."
It would be nice for the beginner to see an example of this and as stated it wouldn't take much space in the book to provide one. I think these sort of things would differentiate your book from others. If you made it more friendly more 'practitioners' would be willing to read/use it end-to-end.