[gtycomb]

So many there are. Starting with basic Probability, this lecture series is a good first intro.

https://www.dartmouth.edu/~chance/teaching_aids/books_articl...

Or starting from the basics, and learning how to actually do the number crunching, this is unusually good (Stewart, Introduction to numerical solution of Markov Chains):

https://press.princeton.edu/titles/5640.html

Robert Gallager's MIT lecture series, very well presented, titled Principles of Digital Communications, takes you on another train based on Markov Chains (Kalman filters, etc).

https://ocw.mit.edu/courses/electrical-engineering-and-compu...