AI engineering glossary · Statistics inference

What is statistical power?

Statistical power: The probability that a test will detect an effect of a given size when that effect truly exists, equal to 1 - the Type II error rate. It rises with sample size, effect size and the significance level.

Level: intermediateTopic: Statistics inference

Statistical power: an example

A test with 80 percent power finds a real 2 point lift in 8 of 10 repeated experiments.

Related terms

More Statistics inference terms

Where you learn it

Statistical power is part of the AI Engineering Program, which teaches it with notes, a hands-on lab and an exam. The first lesson is free.

Before you go

Take the cheat sheet with you

One free PDF: the key AI-engineering terms, formulas and Python idioms. No spam; unsubscribe any time.