AI engineering glossary · Probability
What is chain rule of probability?
Chain rule of probability: A way to write a joint probability as a product of conditional ones: P(A1, A2, ..., An) = P(A1) x P(A2 | A1) x ... x P(An | A1, ..., An-1). Language models use it to score a sentence word by word.
Chain rule of probability: an example
P(the, cat, sat) = P(the) x P(cat | the) x P(sat | the, cat).
Related terms
More Probability terms
- Chebyshev's inequality
- Classical probability
- Cluster sampling
- Combination
- Complement rule
- Conditional distribution
- Conditional expectation
- Conditional probability
Where you learn it
Chain rule of probability is part of the AI Engineering Program, which teaches it with notes, a hands-on lab and an exam. The first lesson is free.