For irreversible computation, yup. If reversible computation turns out to be practical, things are a little weirder, and the bounds are... further away.
The Landauer limit is dependent on temperature, though. If you fast forward the universe a little bit to let the CMB cool down, even irreversible computing can get pretty efficient in theory.