AI engineering glossary · LLM training alignment
What is data curation?
Data curation (also called Data filtering, Quality filtering): The process of selecting, cleaning, filtering and balancing training data to raise its quality, using heuristics, classifiers and human review. For language models it often matters as much as model size.
Data curation: an example
Removing boilerplate pages and low-quality forum text from a crawl before pretraining.
Related terms
More LLM training alignment terms
- Data mixture
- Debate (AI safety)
- DeepSpeed
- Direct preference optimisation
- Domain-adaptive pretraining
- DoRA
- Double quantisation
- Emergent abilities
Where you learn it
Data curation is part of the AI Engineering Program, which teaches it with notes, a hands-on lab and an exam. The first lesson is free.