[maxmouchet]

For an introduction to discrete and continuous-time Markov chains, as well as an application to queuing theory, you can check the MOOC "Queuing Theory: from Markov Chains to Multi-Server Systems" on edX [1].

[1] https://www.classcentral.com/course/edx-queuing-theory-from-...