AI engineering glossary · NLP embeddings
What is CBOW (continuous bag of words)?
Continuous bag of words (also called CBOW): A Word2Vec architecture that averages the vectors of the surrounding context words and uses that average to predict the centre word. It trains faster than skip-gram and works well for frequent words.
Continuous bag of words: an example
Given context [we, drink, chai], CBOW learns to predict the missing word "hot".
Related terms
More NLP embeddings terms
- Coreference resolution
- Corpus
- Cross-encoder
- Cross-lingual transfer
- Dependency parsing
- Distributional hypothesis
- Document-term matrix
- Dot product similarity
Where you learn it
Continuous bag of words is part of the AI Engineering Program, which teaches it with notes, a hands-on lab and an exam. The first lesson is free.