AI engineering glossary · LLM training alignment
What is model collapse?
Model collapse: The degradation that occurs when models are trained repeatedly on data produced by earlier models, so rare patterns in the original data vanish and outputs become more uniform, repetitive and less accurate with each generation.
Model collapse: an example
After several rounds of training on its own generated text, a model loses uncommon words and unusual facts.
Related terms
More LLM training alignment terms
- Model FLOPs utilisation
- Model merging
- Next-token prediction
- NormalFloat 4-bit
- Odds ratio preference optimisation
- Overtrained model
- Paged optimisers
- Parameter-efficient fine-tuning
Where you learn it
Model collapse is part of the AI Engineering Program, which teaches it with notes, a hands-on lab and an exam. The first lesson is free.