Markov chains - notes by J.E.Beasley

These notes by J.E.Beasley were part of a course given at Imperial College, UK.

Have a look at:

• the use of state-transition diagrams
• the Crispy and Crunchy absorbing states in the chip problem.