Introduction to Matrix Analytic Methods in Stochastic Modeling IV: The Censored Markov Chain and Its Stationary DistributionTextbook
Matrix analytic methods compute the stationary distribution of structured Markov chains (quasi-birth-and-death processes, M/G/1- and GI/M/1-type chains) by working on one block of states at a time. Every such computation rests on one device: watch the chain only while it is in a subset of the state space, and describe what happens in between through…