AI engineering glossary · NLP embeddings
What is vocabulary?
Vocabulary (also called Vocab): The fixed list of distinct tokens a model or tokeniser knows, each paired with a unique integer ID. Text is converted to IDs using this list, and anything outside it must be split further or replaced by an unknown token.
Vocabulary: an example
A vocabulary of 32,000 entries maps "the" to ID 5, "chai" to ID 9021, and so on.
Related terms
More NLP embeddings terms
- Vocabulary size
- Word analogy
- Word embedding
- Word sense disambiguation
- Word tokenisation
- Word2Vec
- WordPiece
- Zipf's law
Where you learn it
Vocabulary is part of the AI Engineering Program, which teaches it with notes, a hands-on lab and an exam. The first lesson is free.