AI engineering glossary · Transformers LLM architecture
What is instruct model?
Instruct model (also called Chat model, Instruction-tuned model): A base model that has been further trained on examples of instructions and good responses, and often on human preference data, so it follows requests and holds conversations. Chat assistants are instruct models, typically released alongside the base model.
Instruct model: an example
Llama releases a base checkpoint and an 'Instruct' checkpoint, and the Instruct one answers questions directly.
Related terms
More Transformers LLM architecture terms
- KV cache
- Large language model
- Learned positional embedding
- Length penalty
- Linear attention
- Llama
- LM head
- Load-balancing loss
Where you learn it
Instruct model is part of the AI Engineering Program, which teaches it with notes, a hands-on lab and an exam. The first lesson is free.