AI engineering glossary · Evaluation metrics
What is isotonic calibration?
Isotonic calibration (also called isotonic regression calibration): A calibration method that fits a monotonic, step-shaped function mapping raw scores to probabilities, using held-out data. It is more flexible than Platt scaling and can fix distorted probability shapes, but needs more data and can overfit small sets.
Isotonic calibration: an example
On a 50,000-row validation set, isotonic calibration maps scores to probabilities with a staircase curve that never decreases.
Related terms
More Evaluation metrics terms
- Jaccard index
- Kendall's tau
- Kolmogorov-Smirnov statistic
- Krippendorff's alpha
- Likelihood ratio
- Log loss
- Macro averaging
- Matthews correlation coefficient
Where you learn it
Isotonic calibration is part of the AI Engineering Program, which teaches it with notes, a hands-on lab and an exam. The first lesson is free.