Apparently, TAI specifically defines the second (in terms of cesium transitions) at sea level (where gravitational potential is equal). I never knew that second part.
https://en.wikipedia.org/wiki/Ocean_surface_topography
https://en.wikipedia.org/wiki/Geoid
https://en.wikipedia.org/wiki/Ocean_surface_topography
https://en.wikipedia.org/wiki/Geoid