AI engineering glossary · Generative media multimodal
What is codebook?
Codebook: A learned table of vectors used in vector quantisation, where each continuous feature is replaced by the index of its nearest table entry. It turns images or audio into sequences of discrete tokens and is a key part of VQ-VAEs and neural audio codecs.
Codebook: an example
A codebook of 1024 entries lets each audio frame be stored as a single integer from 0 to 1023.
Related terms
More Generative media multimodal terms
- Conditional GAN
- Consistency model
- Content provenance
- ControlNet
- Cross-attention conditioning
- Cross-modal retrieval
- CycleGAN
- Deepfake
Where you learn it
Codebook is part of the AI Engineering Program, which teaches it with notes, a hands-on lab and an exam. The first lesson is free.