AI engineering glossary · Reinforcement learning
What is TD3 (Twin delayed DDPG)?
Twin delayed DDPG (also called TD3): An improvement on DDPG that uses two critics and takes the smaller value to reduce overestimation, delays actor updates relative to critic updates, and smooths target actions with noise. It is markedly more stable on continuous-control tasks.
Twin delayed DDPG: an example
Target value uses min(Q1, Q2), so an overly optimistic critic cannot inflate the target.
Related terms
- Deep deterministic policy gradient
- Overestimation bias
- Soft actor-critic
- Actor-critic
More Reinforcement learning terms
Where you learn it
Twin delayed DDPG is part of the AI Engineering Program, which teaches it with notes, a hands-on lab and an exam. The first lesson is free.