AI engineering glossary · Statistics inference
What is sequential testing?
Sequential testing: Methods that let you examine experiment data at multiple times and stop early while still controlling the overall false-positive rate. They adjust thresholds at each look instead of using one fixed cut-off.
Sequential testing: an example
A group sequential design with pre-set looks at 25, 50, 75 and 100 percent of the sample lets a clear winner be declared early.
Related terms
More Statistics inference terms
- Significance level
- Spearman rank correlation
- Standard error of the mean
- Statistic
- Statistical power
- Student's t-test
- t-distribution
- Test statistic
Where you learn it
Sequential testing is part of the AI Engineering Program, which teaches it with notes, a hands-on lab and an exam. The first lesson is free.