My user experience on several recent trips is that Google Maps showed me the exit number for the exit I would use next very prominently on top of the display (where it shows the direction of the next turn). Maybe that isn't rolled out consistently for all trips.
Context is when you are not using GPS. (Personally I despise being talked at by a computer for an hour, especially one that's bad at directing a driver.)
With paper maps, you can just look at them -- a single page, no pinch zooming or scrolling! -- to see what exit is appropriate for your destination. Not possible with Google Maps -- you either have to zoom in until the exit ramp fills the screen, or make up a fake address near where you're going to get directions which you then have to read through to find the relevant exit. It's a needless frustration when I'm in a hurry and just what to know what exit serves town X.
I feel you on the talking part. Especially maddening to me is where it talks over an in-progress conversation to tell us things we already know.
I now generally turn the audio part off except for alerts. I like that better, not only is it more soothing, but it forces me to engage my brain a little more.