AI engineering glossary · Reinforcement learning
What is horizon?
Horizon: The number of future steps the learner cares about when planning. It can be a fixed finite number, unbounded, or effectively set by the discount factor. Short horizons favour quick gains; long ones favour delayed payoffs.
Horizon: an example
A stock-trading learner with a 5-day horizon chases short swings, while one with a 250-day horizon aims at yearly returns.
Related terms
More Reinforcement learning terms
- Imitation learning
- Importance sampling ratio
- Intrinsic motivation
- Inverse reinforcement learning
- Markov decision process
- Maximum entropy reinforcement learning
- Model predictive control
- Model-based
Where you learn it
Horizon is part of the AI Engineering Program, which teaches it with notes, a hands-on lab and an exam. The first lesson is free.