Millions of people allow Google to read their email because that's the free option. Also because Google doesn't straight up tell you humans are hand sorting it. A human at Google can probably read my email as easily as some one can open my mailbox in meatspace, but both are assumed to be exceptions.
Edit to add: also Google does not ask for a key to my house.