- Find the stationary distribution of a Markov chain X0, X1, X2, . . . on the state space {0,1,…,110}, with transition probabilities given by P(XT,÷1 = jiXn = 0) = p, for j = 1,2,…,110;
P(Xnti = 01)Cn = 0) = 1 — 110p; P(Xnti = jiXn = j) = 1 – r, for j = 1, 2, … , 110; P(Xn÷i = 01Xn = j) = r, for j = 1,2,…,110, where p and r are constants with 0 < p < Tiz and 0 < r < 1.
Sample Solution
