I spend very little time zoomed in. Mostly when trying to pick up a ground target. I agree it feels very wrong in VR.