AI engineering glossary · LLM training alignment
What is Evol-Instruct?
Evol-Instruct: A method that uses a language model to rewrite instructions into progressively harder or more complex versions, for instance by adding constraints or requiring deeper reasoning, producing a more varied and difficult instruction dataset.
Evol-Instruct: an example
'Write a function to add two numbers' evolves into 'Write a function that adds two numbers given as strings, handling negative values'.
Related terms
More LLM training alignment terms
- Exposure bias
- FLAN
- FLOPs
- Foundation model
- FP8 training
- Full fine-tuning
- Fully sharded data parallel
- Generalised advantage estimation
Where you learn it
Evol-Instruct is part of the AI Engineering Program, which teaches it with notes, a hands-on lab and an exam. The first lesson is free.