AI engineering glossary · NLP embeddings
What is corpus?
Corpus (also called Text corpus, Corpora): A large, organised collection of text used to study language or to train and test language models. Corpora may be raw web pages, books or news, or carefully annotated with labels such as parts of speech. The quality and coverage of a corpus strongly shape what a model learns.
Corpus: an example
A corpus of 2 million Hindi news articles is used to train a tokeniser and a word-embedding model.
Related terms
More NLP embeddings terms
- Cross-encoder
- Cross-lingual transfer
- Dependency parsing
- Distributional hypothesis
- Document-term matrix
- Dot product similarity
- ELMo
- Entity linking
Where you learn it
Corpus is part of the AI Engineering Program, which teaches it with notes, a hands-on lab and an exam. The first lesson is free.