This is where you're incorrect. Not having to accelerate the empty first stage to orbital speed (and back!) is a huge fuel savings.