AI engineering glossary · LLM training alignment
What is reasoning model?
Reasoning model: A language model trained, often with reinforcement learning on checkable problems, to produce a long chain of intermediate thinking before its final answer. Spending more tokens on thinking tends to improve accuracy on maths, coding and logic tasks, at higher latency and cost.
Reasoning model: an example
Asked a puzzle, a reasoning model writes several hundred tokens of working, checks itself, and only then gives the answer.
Related terms
- Test-time compute scaling
- Reinforcement learning with verifiable rewards
- Chain-of-thought
- Group relative policy optimisation
More LLM training alignment terms
- Reinforcement learning from AI feedback
- Reinforcement learning from human feedback
- Reinforcement learning with verifiable rewards
- Rejection sampling fine-tuning
- Reward hacking
- Reward model
- Safety fine-tuning
- Scalable oversight
Where you learn it
Reasoning model is part of the AI Engineering Program, which teaches it with notes, a hands-on lab and an exam. The first lesson is free.