It's perhaps not terribly surprising that it becomes possible with unlimited width or depth (or an arbitrarily complex activation function).
https://en.wikipedia.org/wiki/Universal_approximation_theore...