Since we experience this distortion for anything we look at, aren't our brains equipped to handle it? Can we really call it a distortion if that is true?
Also consider that the brain already corrects for the upside down image on the retina, and the stereoscopic input due to having two eyes. The brain's plasticity is slightly underrated.
Reminds me of how a new eyeglass prescription may make the edges of images coming through the lenses look curved or distorted, but after a couple days everything looks straight again.