Long-Run Behavior of Markov Chains
摘要
This chapter is concerned with the behavior of Markov chains in large time, including the computation of their limiting and stationary distributions. Here, the notions of recurrence, transience, and classification of states introduced in the previous chapter play a major role.