Smith is in jail and has 1 dollar; he can get out on bail if he has 8 dollars.A guard agrees to make a series of bets with him. If Smith bets A dollars, he wins A dollars with probability .4 and loses A dollars with probability .6.
Find the probability that he wins 8 dollars before losing all of his money if
This is “The Gambler’s Ruin Problem” from pg. 487 in section 12.2 of our probability textbook. The gambler starts with a stake of size \(s\) and plays until their stake reaches the value \(M\) or the value \(0\) (absorbing states).
(a) he bets 1 dollar each time (timid strategy).
\(P_{broke} = \frac{(q/p)^z - (q/p)^M}{(1 - q/p)^M}\)
\(P_{winning} = 1 - P_{broke} = 1 - \frac{(0.6/0.4)^1 - (0.6/0.4)^8}{1 1 (0.6/0.4)^8} =\)
1 - ((1.5- (1.5^8)) / (1- (1.5^8)))
## [1] 0.02030135
(b) he bets, each time, as much as possible but not more than necessary to bring his fortune up to 8 dollars (bold strategy).
In a), the probability computed was the probability of making 8 moves to the right. If the gambler wagered $1 and won, they’d have $2. Then, if they wagered $2 and won, they’d have $4. Lastly, if they wagered $4 and won, they’d have $8. This is 3 moves to the right instead of 8.
\(P_{winning} = 1 - P_{broke} = 1 - \frac{(0.6/0.4)^1 - (0.6/0.4)^3}{1 1 (0.6/0.4)38} =\)
1 - ((1.5- (1.5^3)) / (1- (1.5^3)))
## [1] 0.2105263
(c) Which strategy gives Smith the better chance of getting out of jail?
Strategy b) gives a better chance of winning because it requires less moves to the right.