[crgwbr]

In a vacuum, maybe. But in any atmosphere, removing the thrust means negative acceleration due to drag. Thus the propellant could start to drift up/forward.