But he passes the cost of those taxes on to the renter because the renter is the one benefiting from the schools/roads/police/fire/etc that the taxes fund.
That is often true. A vacant rental still owes the taxes though. I can only say my time as a landlord I have not always covered those costs with rental income. Sometimes the property is empty or doesn't command enough income to cover all your costs.