[wyager]

Pretty sure it's been proven that sufficiently large 3-layer networks can learn any function.

[danbruc]

It's called the Universal Approximation Theorem [1].

[1] https://en.wikipedia.org/wiki/Universal_approximation_theore...