AI engineering glossary · LLM training alignment
What is alignment?
Alignment (also called AI alignment): The effort to make an AI system pursue the goals and follow the values its designers and users actually intend. For language models this covers following instructions, being truthful and refusing harmful requests, using methods such as fine-tuning on human feedback.
Alignment: an example
Two models can be equally capable, but the aligned one declines to give instructions for fraud and admits when it does not know an answer.
Related terms
More LLM training alignment terms
- Alignment tax
- Alpaca
- Base model
- Bradley-Terry model
- Causal language modelling
- Chat template
- Chinchilla scaling
- Chosen and rejected responses
Where you learn it
Alignment is part of the AI Engineering Program, which teaches it with notes, a hands-on lab and an exam. The first lesson is free.