AI engineering glossary · Deep learning core
What is hidden state?
Hidden state: The vector a recurrent network carries from one time step to the next, summarising what it has seen so far. It is recomputed at each step from the new input and the previous state.
Hidden state: an example
After reading 'the monsoon has', an RNN's 128-number state encodes context used to predict the next word.
Related terms
More Deep learning core terms
- Huber loss
- Input layer
- Instance normalisation
- Iteration
- Label smoothing
- LAMB optimiser
- Layer
- Layer normalisation
Where you learn it
Hidden state is part of the AI Engineering Program, which teaches it with notes, a hands-on lab and an exam. The first lesson is free.