AI engineering glossary · LLM training alignment
What is alpaca?
Alpaca (also called Stanford Alpaca): An early open instruction-tuned model and dataset from Stanford, produced by fine-tuning a LLaMA model on about 52,000 instruction-following examples generated by prompting another model. It popularised the recipe of fine-tuning on model-generated instructions.
Alpaca: an example
Alpaca-style datasets pair an instruction, optional input and output in a simple JSON record.
Related terms
More LLM training alignment terms
- Base model
- Bradley-Terry model
- Causal language modelling
- Chat template
- Chinchilla scaling
- Chosen and rejected responses
- Clipped surrogate objective
- Common Crawl
Where you learn it
Alpaca is part of the AI Engineering Program, which teaches it with notes, a hands-on lab and an exam. The first lesson is free.