To each his own, I suppose. I wouldn't wear a regular watch in the shower, so it's just habit to take it off. Apple also doesn't recommend exposing it to the shower / soap [1] but based on your experience it seems that might be to cover themselves just in case.
[1] https://support.apple.com/en-us/HT205000