In this program
- Discrete-time Markov chains: classification of states
- Stationary distributions
- Ergodicity
- Continuous-time Markov chains
- Birth–death and queueing models
- MCMC as Markov chains
Markov chains
Discrete-time Markov chains: classification of states
Stochastic processes (statistics) · Theoretical / proof-based
Topic
Discrete-time Markov chains: classification of states
Graduate Stochastic processes — outline derived from course README sections and typical US statistics syllabi (OpenIntro / standard OER where applicable).