That's exactly why I stopped using Uber. It was annoying to not get notification when drivers arrive, but there's no way I'm giving them free access to make my pocket vibrate all day long.
If you turn off notifications they will use text messages to contact you. I’ve never gotten a spam text message from them, which makes some sense as they’re more regulated than push notifications.