AI engineering glossary · Classical ML algorithms
What is decision stump?
Decision stump: A tree with just one split, which makes a prediction from a single feature and a single threshold. It is extremely simple and cheap to train, and it is the classic weak learner used inside AdaBoost, where many are combined into a stronger model.
Decision stump: an example
A stump that predicts 'spam' whenever the count of the word 'lottery' is above 2.
Related terms
More Classical ML algorithms terms
- Decision tree
- Dendrogram
- Dimensionality reduction
- Elastic net
- Elbow method
- Ensemble learning
- Entropy
- Euclidean distance
Where you learn it
Decision stump is part of the AI Engineering Program, which teaches it with notes, a hands-on lab and an exam. The first lesson is free.