You can acclimatise to it but cold shock response is a very real thing. The first minute is the most important - you're lucky to survive long enough to die of hypothermia.
The typical way people swim among ice is to first just dip yourself, get up from the water, hang out for like a minute, then go back in there. I wonder if this has something to do with it?