[Mithriil]

I don't think that this is true. You need an infinite number of dimensions for this (think Taylor's expansion, Fourier expansion, infinitely wide or deep NNs..)

[jmalicki]

Yes, you do linear interpolation between an infinite number of data points.