Hacker News new | ask | show | jobs
by barrenko 524 days ago
How would you describe what a neural ODE is in the simplest possible terms? Let's say I know what an NN and a DE are :).
1 comments

classic NN takes a vector of data through layers to make a prediction. Backprop adjusts network weights till predictions are right. These network weights form a vector, and training changes this vector till it hits values that mean "trained network".

Neural ODE reframes this: instead of focusing on the weights, focus on how they change. It sees training as finding a path from untrained to trained state. At each step, it uses ODE solvers to compute the next state, continuing for N steps till it reaches values matching training data. This gives you the solution for the trained network.

Pretty cool approach, looking more into it, thank you!