AI engineering glossary · Reinforcement learning
What is TD(0)?
TD(0): The simplest temporal-difference prediction method, which updates the value of a situation using only the next step: V(s) = V(s) + alpha * [r + gamma * V(s') - V(s)]. The 0 means it looks just one step ahead.
TD(0): an example
With alpha = 0.1 and a TD error of 1.4, V(s) rises by 0.14.
Related terms
More Reinforcement learning terms
- TD(lambda)
- Temporal-difference learning
- Terminal state
- Thompson sampling
- Transition probability
- Twin delayed DDPG
- Upper confidence bound
- Value iteration
Where you learn it
TD(0) is part of the AI Engineering Program, which teaches it with notes, a hands-on lab and an exam. The first lesson is free.