[red75prime]

There's no theorem that SGD is insufficient. So, as I said, it's empirical.

[forgot-im-old]

You said it only depends on network size, I'm saying it more likely is impossible regardless of network size due to fundamental limits in training methods.