AI engineering glossary · Evals guardrails AI security
What is elo rating?
Elo rating: A rating system, originally for chess, where each player has a score that rises after a win and falls after a loss, by more when the result was unexpected. In AI evaluation it turns many head-to-head votes between models into a single leaderboard number.
Elo rating: an example
Model A rated 1200 beats model B rated 1300; because the win was unlikely, A gains more points than it would beating a weaker rival.
Related terms
More Evals guardrails AI security terms
- Encoding attack
- Eval set
- Evaluation harness
- Evasion attack
- Excessive agency
- Extrinsic hallucination
- Fast Gradient Sign Method
- G-Eval
Where you learn it
Elo rating is part of the AI Engineering Program, which teaches it with notes, a hands-on lab and an exam. The first lesson is free.