AI engineering glossary · Deep learning core
What is cell state?
Cell state: The internal memory vector of an LSTM that runs along the sequence with only small, gated modifications. Because it is updated mostly by addition, information and gradients can travel through many steps with little loss.
Cell state: an example
At each step the forget gate multiplies the cell state by values between 0 and 1 to discard outdated information.
Related terms
More Deep learning core terms
- Checkpoint
- Cross-entropy loss
- Curriculum learning
- Cyclical learning rate
- Data parallelism
- Deep learning
- Deep neural network
- DropConnect
Where you learn it
Cell state is part of the AI Engineering Program, which teaches it with notes, a hands-on lab and an exam. The first lesson is free.