I'm guessing segments just use the elevation data of the activity that they were created from, hence why they can be wildly wrong.