Yeah, it is actually silly if you don't have a decent DEM, though you can get away with a geoid approximation if you only want to render a pretty picture for someone navigating to the nearest ATM.
fortunately, between SRTMv3, ASTER, ArcticDEM and REMA, a free DEM is available for practically the entire world (maybe missing some subantarctic islands?).