[dontreact]

The sim to real gap is very large and it honestly seems to me like maybe most of the work is not in the RL part of it but rather instrumenting the robot properly, setting up the right simulation, figuring out how to scale up the real world learning. Haven't seen much robotics stuff come out of Deepmind yet, maybe for these reasons.

[sjg007]

You need algorithms that can learn complex tasks and also reason under uncertainty. Not just uncertainty of sensor inputs but also uncertainty of state. The goal of all of these video games is to develop the algorithms over a wide range of difficulty. So algorithms that have memory, learn / plan and are reasonably robust etc...