[zardo]

In an inverted pendulum the support pushes up, in a rocket it pushes along the direction the rocket is pointed. You only need to steer the rocket, not balance it.

[regularfry]

In a very real sense, you only need to "steer" the inverted pendulum, too.