AI engineering glossary · Deep learning core
What is bottleneck?
Bottleneck: A deliberately narrow layer in a network that forces information through far fewer units than the layers around it. It compresses data into its essential features, reduces parameter counts and, in autoencoders, is where the compact code lives.
Bottleneck: an example
A layer of 32 units between layers of 784 and 784 is a bottleneck in an autoencoder.
Related terms
More Deep learning core terms
- Catastrophic forgetting
- Cell state
- Checkpoint
- Cross-entropy loss
- Curriculum learning
- Cyclical learning rate
- Data parallelism
- Deep learning
Where you learn it
Bottleneck is part of the AI Engineering Program, which teaches it with notes, a hands-on lab and an exam. The first lesson is free.