A bit flip at the most significant bit is a one cycle 22.05kHz pulse - so yes you almost certainly wouldn't hear it even if the speaker could reproduce it.
You would totally hear it, as a small click. I had a bug in some audio software I was working with that did almost exactly this, and it sounded terrible.