1:07 Definition of a stochastic process
5:51 Definition of a Markov chain/process (informal)
13:29 Review of conditional probability
17:07 Conditioning on a random variable
20:22 Double conditioning
22:18 Definition of a Markov chain/process (formal)
42:42 The Transition Probability Matrix
50:08 Computational Example
1:11:53 The Chapman-Kolmogorov Equations