AI engineering glossary · Reinforcement learning
What is value iteration?
Value iteration: A planning method that repeatedly updates each situation's value to the best one-step lookahead: the maximum over choices of immediate score plus discounted value of the next situation. When the values stop changing, the best rule follows greedily. It requires knowing the transition model.
Value iteration: an example
Update V(s) = max over a of [r + 0.9 * V(s')] for all states until changes fall below 1e-6.
Related terms
More Reinforcement learning terms
Where you learn it
Value iteration is part of the AI Engineering Program, which teaches it with notes, a hands-on lab and an exam. The first lesson is free.