AI engineering glossary · Statistics inference
What is FWER (family-wise error rate)?
Family-wise error rate (also called FWER): The probability of making at least one false positive across a whole set of related tests. Corrections such as Bonferroni aim to keep it below a chosen level. It grows quickly as the number of tests increases.
Family-wise error rate: an example
In a test with 10 metrics, keeping this rate at 0.05 requires stricter thresholds for each individual metric.
Related terms
More Statistics inference terms
- Fisher information
- Fisher's exact test
- Frequentist inference
- Generalised linear model
- Guardrail metric
- Heteroscedasticity
- Homoscedasticity
- Instrumental variable
Where you learn it
Family-wise error rate is part of the AI Engineering Program, which teaches it with notes, a hands-on lab and an exam. The first lesson is free.