Do your special skills work as well with your eyes closed? It may be that you’re very good at integrating external waypoints and references, and simply lack those for time.
Vision is an important part of my navigational ability, but I can (very rarely) sense location with eyes closed - eg. with eyes closed on a train/airplane being able to guess where I am on the journey (hard to explain, sorry).