AI engineering glossary · Classical ML algorithms
What is shrinkage?
Shrinkage: Scaling down each new tree's contribution in boosting by a small factor, the learning rate, so the ensemble improves in tiny steps. Smaller values need more trees but usually generalise better.
Shrinkage: an example
Using learning_rate=0.05 with 600 trees often beats learning_rate=0.5 with 60 trees.
Related terms
More Classical ML algorithms terms
- Sigmoid function
- Silhouette score
- Simple linear regression
- Soft margin
- Softmax regression
- Spectral clustering
- Stacking
- Support
Where you learn it
Shrinkage is part of the AI Engineering Program, which teaches it with notes, a hands-on lab and an exam. The first lesson is free.