AI engineering glossary · LLM training alignment
What is FLAN?
FLAN: Finetuned Language Net, a line of work that instruction-tunes models on a large collection of existing NLP tasks rewritten as natural-language instructions. It showed that training on many tasks improves zero-shot performance on unseen tasks.
FLAN: an example
A sentiment dataset becomes 'Is this review positive or negative? [review]' with the label as the answer.
Related terms
More LLM training alignment terms
- FLOPs
- Foundation model
- FP8 training
- Full fine-tuning
- Fully sharded data parallel
- Generalised advantage estimation
- Goodhart's law
- Group relative policy optimisation
Where you learn it
FLAN is part of the AI Engineering Program, which teaches it with notes, a hands-on lab and an exam. The first lesson is free.