AI engineering glossary · Evaluation metrics
What is MAUVE?
MAUVE: A metric for open-ended text generation that measures how close the distribution of machine-generated text is to human-written text. It embeds both sets, groups them into clusters and compares cluster proportions along a divergence frontier, capturing both low-quality and low-diversity output. Higher is better.
MAUVE: an example
Comparing 5,000 story continuations from a model with 5,000 human ones, a MAUVE near 1 suggests the model's text is statistically hard to tell apart from human writing.
Related terms
More Evaluation metrics terms
- Max error
- Maximum calibration error
- McNemar's test
- Mean absolute error
- Mean absolute percentage error
- Mean absolute scaled error
- Mean average precision
- Mean bias error
Where you learn it
MAUVE is part of the AI Engineering Program, which teaches it with notes, a hands-on lab and an exam. The first lesson is free.