[felippee]

Though I agree with the spirit of what you are saying, I would add that it is perhaps not the weakness of neural networks per se, but weakness of the current architectures and training (supervised, hence verbalized) paradigms. I think we could do much more to improve things, if we stopped pushing for extra % on benchmarks and instead rethink the problems we'd like to solve and approach them from a new angle.