AI engineering glossary · Statistics inference
What is power analysis?
Power analysis (also called Sample size calculation): A calculation done before collecting data to find the sample size needed to detect an effect of a chosen size with a chosen power and significance level. It prevents experiments that are too small to be informative.
Power analysis: an example
Detecting a rise in conversion from 5 to 6 percent at 5 percent significance and 80 percent power needs roughly 8,000 users per group.
Related terms
More Statistics inference terms
- Practical significance
- Prior distribution
- Propensity score
- R-squared
- Randomisation
- Randomised controlled trial
- Regression coefficient
- Regression to the mean
Where you learn it
Power analysis is part of the AI Engineering Program, which teaches it with notes, a hands-on lab and an exam. The first lesson is free.