Yeah. Maybe you wipe down the book after you finish it and replace it with another book, but in terms of self hygiene you should be washing your hands after using the toilet anyway.
Don't know of anyone who'd truly appreciate it but it'd be basically impossible to know about unless you did a test/asked etc. The Seinfeld episode on the subject is funny but quite dramatized.
The point being we all interact with fecal matter way more than anyone would like to know - even just by smelling.
It's been a topic for climbing gyms [1] and have heard the same for hand shakes but no link provided