The Limiting Distribution 1.
Consider the product of P with itself
In general is the n-step transition probability matrix
- probabilities of going from state i to j in exactly n steps
All ways of going from state 1 to state 2 in two steps
Probability of going from state 3 to state 2 in two steps