Discussion week10

Week 10, Markov Chains / Random Walks

Fundamentals of Computational Mathematics

CUNY MSDS DATA 605, Fall 2018

Rose Koh

10/31/2018
Chapter 11,12
Section 11.1.11

Assume that a man’s profession can be classified as professional, skilled laborer, or unskilled laborer. Assume that, of the sons of professional men, 80 percent are professional, 10 percent are skilled laborers, and 10 percent are unskilled laborers. In the case of sons of skilled laborers, 60 percent are skilled laborers, 20 percent are professional, and 20 percent are unskilled. Finally, in the case of unskilled laborers, 50 percent of the sons are unskilled laborers, and 25 percent each are in the other two categories. Assume that every man has at least one son, and form a Markov chain by following the profession of a randomly chosen son of a given family through several generations.

The set states for this markov chain in the exercise is as following:

\(S = {Professional, Skilled, Unskilled}\)

with the transition probabilities:

\(P = \begin{pmatrix} & Professional & Skilled & Unskilled\\ Professional & 0.8 & 0.1 & 0.1\\ Skilled & 0.2 & 0.6 & 0.2\\ UnSkilled & 0.25 & 0.25 & 0.5\end{pmatrix}\)

Transition matrix for this chain:

\(P = \begin{pmatrix} 0.8 & 0.1 & 0.1\\ 0.2 & 0.6 & 0.2\\ 0.25 & 0.25 & 0.5\end{pmatrix}\)

p = matrix( c(0.8, 0.2, 0.25, .1, .6, .25,.1,.2,.5), nrow=3, ncol=3)
p
##      [,1] [,2] [,3]
## [1,] 0.80 0.10  0.1
## [2,] 0.20 0.60  0.2
## [3,] 0.25 0.25  0.5
p1=p %^% 2

p1
##       [,1]  [,2]  [,3]
## [1,] 0.685 0.165 0.150
## [2,] 0.330 0.430 0.240
## [3,] 0.375 0.300 0.325

The probability of a randomly chosen grandson of an unskilled-labourer is a professional man, is .375