Hacker News new | ask | show | jobs
by onuralp 3239 days ago
This reminds me of Ferenc's reminder that 'deep learning is easy' - 'http://www.inference.vc/deep-learning-is-easy/
1 comments

I am not sure he even understands complexity of DL itself. DL can be formulated as a non-linear optimization problem; that means it's one of the most difficult computational problems and the few types of topology we know are working with current "simple" non-linear optimizers are quite miraculous; I don't think anybody understands why these simple methods work so well when we restrict/structure the number of connections between layers and why fully-connected networks have such a terrible performance even if theoretically they should be able to handle everything better. So there is IMO a plenty of space for everyone to figure out their own niche with best performing algorithm in production and enable magical things in their apps.