Hacker News new | ask | show | jobs
by magic_hamster 269 days ago
A million things.

Diffusion, back propagation, attention, to name a few.

1 comments

Back prop and attention are just extensions of interpolation.
By that logic it's all "just linear maths".

Back prop requires and limits to analytically differentiable in a normal way.

Attention is... Oh dear comparing linear regression to attention is comparing a diesel jet engine to a horse.

It's all just a series of S(S(S(....S(0)))) anyways.