AI engineering glossary · Classical ML algorithms
What is regression tree?
Regression tree: A decision tree that predicts a number. Each leaf holds the average target of the training rows that land in it, and splits are chosen to cut squared error the most. It gives step-shaped predictions and captures interactions without any feature scaling.
Regression tree: an example
A tree predicting house price might split on area, then locality; a leaf with 12 training flats averaging 48 lakh predicts 48 lakh for any new flat landing there.
Related terms
More Classical ML algorithms terms
- Residual
- Ridge regression
- Scree plot
- Shrinkage
- Sigmoid function
- Silhouette score
- Simple linear regression
- Soft margin
Where you learn it
Regression tree is part of the AI Engineering Program, which teaches it with notes, a hands-on lab and an exam. The first lesson is free.