Hacker News new | ask | show | jobs
by Cybiote 3313 days ago
> You ignored my post entirely.

I did not. You said Go is in a lot of respect much more challenging than machine translation, speech to text and auto-driving. I merely pointed out that is wrong because the following exists: superhuman go player and the following do not: superhuman machine translation,speech to text and auto-driving. Go is a perfect information game with no shallow traps. Perfect information means unlike poker, information sets are not cross cutting and as such algorithms can leverage the fact that backwards induction is straightforward.

No shallow search traps and perfect information makes things a lot easier from a computational perspective. Driving at a superhuman level would require a sophisticated forward model from a physics perspective, before even considering predicting other drivers. Speech to text and fluent translation without brittle edge-cases requires hierarchical predictive models that capture long term correlations and higher order concepts. I'm not disputing Go is hard but the hurdles: high branching factor and no evaluation heuristic were the core difficulties. Training via reinforcement in a way that broke correlations which get in the way of learning and integrating roll out with the neural nets (breaking evaluation into value and policy as they did) was the Deepmind's team genius. The roll out and evaluation are what eat up so much electricity.

> The fact that it took the most elite ML lab in the world to engineer this solution using proprietary hardware never seen before that's orders of magnitudes faster at evaluating than what's available to the rest of us is a testament to how hard it is to beat Go.

AlphaGo can run on a GPU, just not (for now) as efficiently as on a TPU. Deepmind is indeed unmatched in output. AlphaGo did build on the 2006 breakthrough paper on tree based bandit algorithms. There was another important 2014 paper on the use of conv-nets on Go. Deepmind did amazing work, but it was not out of nowhere.

And, sure Go is hard. But from a computational perspective, it is still much easier than being able to run up a hill or climb a tree. Humans are just not very good at playing combinatorial games, so the ceiling is low.

> I am merely pointing out that it comes with a broad set of challenges that you aren't even aware of and is a lot harder thank you think.

That is absolutely untrue. I have a decent understanding of the implementation and a strong understanding of the underlying algorithms.