[Jataman606]

You could create interface where human operator uses tablet like you would play video games. Creators would have to program some predefinied possible moves like "pick up object", "hit nail" etc. Then you are shown AR recreation of what robot sees with objects that you can interact with highlighted on screen. Then you just click, maybe select appropriate action from context menu and voila, the metal guy does heavy lifting for you. At least in my opinion it would be superior way to have precise control. Verbal communication is hard, even humans fail at it often.

[kaba0]

I think their “dog-like” robot has such a program. You can make it walk by a joystick, but actual path-planning happens on the robot, so it won’t walk into a wall/avoid obstacles even if you just pressed forward, etc.