| This article was going decently and then it just falls off a cliff. The article basically says:
1) Here’s this complex problem
2) Here’s some hand written heuristics
3) Here’s a shitty neural
net
4) Here’s another neural net with some guys last name from the PyTorch library
5) Here are the constraints with adopting neural nets You can see why this is so unsatisfying, the leaps in logic become more and more generous. What I would have loved to see, is a comparison of a spaghetti code implementation vs a neural net implementation on a large dataset/codebase, then show examples in the validation set that maybe the neural net generalizes to, or fails at, but the heuristic fails at, and so on. This would demonstrate the value of neural nets, if for example, there’s a novel example that the neural net finds that the spaghetti heuristic can’t. Show tangible results, show some comparison, show something, giving some rough numbers on the performance of each in aggregate would be really useful. |