Hacker News new | ask | show | jobs
by nekudotayim 267 days ago
What is ML if not interpolation and extrapolation?
1 comments

A million things.

Diffusion, back propagation, attention, to name a few.

Back prop and attention are just extensions of interpolation.
By that logic it's all "just linear maths".

Back prop requires and limits to analytically differentiable in a normal way.

Attention is... Oh dear comparing linear regression to attention is comparing a diesel jet engine to a horse.

It's all just a series of S(S(S(....S(0)))) anyways.