O. Hernández-Lerma

• Markov Chains and Invariant Probabilities
• Markov decision processes