[wasmainiac]

It’s not a 1:1 human motion capture to servo translation. There is some work done to fix Center of gravity like you said and issues with friction and momentum.

The hard part with “autonomy” is interpretation of the environment and feeding that back into some control loop to accomplish a goal in real time. That is why most of these demos are basically recordings of movements, like choreography.

[pixelesque]

They're also interacting with the environment (vaulting boxes / walls), which implies they either know their 3D position very accurately, or they have some form of sensors and can adapt a bit.

[wasmainiac]

That’s fine, static objects can be integrated in to sequences if each unit has enough positional accuracy.

My point is that if you interrupt the sequence by pushing it over or standing in front of it, the unit will not be able to recover or mitigate the issue. I’m not sure about the models in the video but they should enter a safe state, hopefully gracefully.