AI engineering glossary · Classical ML algorithms
What is stacking?
Stacking (also called Stacked generalisation): An ensemble technique where predictions from several different base models become the inputs to a final model that learns how best to combine them. Base predictions are produced out-of-fold to avoid leakage.
Stacking: an example
Feed forest, SVM and logistic predictions into a small logistic model that outputs the final answer.
Related terms
More Classical ML algorithms terms
- Support
- Support vector
- Support vector machine
- Support vector regression
- t-SNE
- Tree pruning
- Truncated SVD
- UMAP
Where you learn it
Stacking is part of the AI Engineering Program, which teaches it with notes, a hands-on lab and an exam. The first lesson is free.