AI engineering glossary · LLM training alignment
What is PRM (process reward model)?
Process reward model (also called PRM): A reward model that scores each intermediate step of a reasoning chain rather than only the final answer. Step-level feedback helps locate where a solution goes wrong, and can guide search or training, at the cost of expensive step-level labels.
Process reward model: an example
In a five-step algebra solution, the model gives steps 1-3 high scores and step 4 a low score where a sign error occurs.
Related terms
- Outcome reward model
- Reward model
- Reasoning model
- Best-of-n sampling
More LLM training alignment terms
- Prompt tuning
- Proximal policy optimisation
- QLoRA
- Rank (LoRA)
- Reasoning model
- Reinforcement learning from AI feedback
- Reinforcement learning from human feedback
- Reinforcement learning with verifiable rewards
Where you learn it
Process reward model is part of the AI Engineering Program, which teaches it with notes, a hands-on lab and an exam. The first lesson is free.