I think it's the opposite, the colder it is the more people heat their homes / cars / dress very warmly. They probably get the least cold exposure naturally.
I grew up in Toronto but I was always much colder in winter when living in Sydney. No insulation, plus vents in the walls and single pane windows mean it's warmer outside but much colder in.
You seem to have never visited warm and cold climates...