AI engineering glossary · NLP embeddings
What is bigram?
Bigram (also called 2-gram): An n-gram of length two: a pair of neighbouring words or characters. Bigrams capture simple phrases and the probability of a word given the previous one, at the cost of many more distinct features than unigrams.
Bigram: an example
The bigrams of "machine learning course" are "machine learning" and "learning course".
Related terms
More NLP embeddings terms
- BILOU tagging
- BIO tagging
- BM25
- Byte-level BPE
- Byte-pair encoding
- Case folding
- Character-level tokenisation
- Chunking
Where you learn it
Bigram is part of the AI Engineering Program, which teaches it with notes, a hands-on lab and an exam. The first lesson is free.