[hacker42]

But MCTS works in AlphaGo because the 'world' can be fully represented by a tiny state vector which fits a billion times into primary memory these days. The real difficultly of real world problems is the ill-defined, mutable, high-dimensional and partially observable state space.

[Eridrus]

I'm merely pointing out that "all neural everything" is not always the best approach despite joint training being very appealing.