AI engineering glossary · Probability
What is markov chain?
Markov chain: A sequence of random states in which the probability of the next state depends only on the current state and not on earlier history. It is described by a table of transition probabilities and models things like page browsing and text generation.
Markov chain: an example
If a user on a 'cart' page goes to 'checkout' with probability 0.3 regardless of how they arrived, that is the Markov property.
Related terms
More Probability terms
- Markov chain Monte Carlo
- Markov property
- Markov's inequality
- Maximum likelihood estimation
- Median
- Memoryless property
- Mode
- Monte Carlo simulation
Where you learn it
Markov chain is part of the AI Engineering Program, which teaches it with notes, a hands-on lab and an exam. The first lesson is free.