AI engineering glossary · Statistics inference
What is novelty effect?
Novelty effect: A temporary change in behaviour caused only by users seeing something new, which fades as they get used to it. It can make a short experiment overstate the lasting benefit of a change.
Novelty effect: an example
A redesigned home screen lifts clicks in week one because it is unfamiliar, then the lift decays by week three.
Related terms
More Statistics inference terms
- Null hypothesis
- One-tailed and two-tailed tests
- P-hacking
- P-value
- Paired t-test
- Peeking problem
- Permutation test
- Point estimate
Where you learn it
Novelty effect is part of the AI Engineering Program, which teaches it with notes, a hands-on lab and an exam. The first lesson is free.