In Example 11.5, find P, P2, and P3. What is Pn?
Example 11.5 Each time a certain horse runs in a three-horse race, he has probability 1/2 of winning, 1/4 of coming in second, and 1/4 of coming in third, independent of the outcome of any previous race. We have an independent trials process,410 CHAPTER 11. MARKOV CHAINS but it can also be considered from the point of view of Markov chain theory. The transition matrix is
\[P=\begin{pmatrix} 0.5 & 0.25 & 0.25\\ 0.5 & 0.25 & 0.25\\ 0.5 & 0.25 & 0.25 \end{pmatrix}\]
p<-matrix(c(0.5,0.5,0.5,0.250,0.250,0.250,0.250,0.250,0.250),nrow=3)
p
## [,1] [,2] [,3]
## [1,] 0.5 0.25 0.25
## [2,] 0.5 0.25 0.25
## [3,] 0.5 0.25 0.25
psquare <- p %*% p
psquare
## [,1] [,2] [,3]
## [1,] 0.5 0.25 0.25
## [2,] 0.5 0.25 0.25
## [3,] 0.5 0.25 0.25
pcube <- p %*% p %*% p
pcube
## [,1] [,2] [,3]
## [1,] 0.5 0.25 0.25
## [2,] 0.5 0.25 0.25
## [3,] 0.5 0.25 0.25
Since \[P^1=P^2=P^3, P^n = P\]
\[P^n=\begin{pmatrix} 0.5 & 0.25 & 0.25\\ 0.5 & 0.25 & 0.25\\ 0.5 & 0.25 & 0.25 \end{pmatrix}\]