> I mean that they would lose ability to tell where is north.
You're aware, I trust, that the sun rises in the east and sets in the west, regardless of hemisphere?
FWiW this isn't a theorectical "what if" .. right from the get go Europeans were taking southern hemisphere indigenous people to the northern hemisphere: