AI engineering glossary · Evals guardrails AI security
What is G-Eval?
G-Eval: A method that uses a strong language model with chain-of-thought reasoning and a form-filling template to score generated text on criteria such as coherence or consistency, weighting the score by token probabilities. It was proposed to align automatic scoring more closely with human ratings.
G-Eval: an example
To grade summaries for coherence, the judge is given step-by-step evaluation instructions, reasons through them, then outputs a 1 to 5 rating.
Related terms
More Evals guardrails AI security terms
Where you learn it
G-Eval is part of the AI Engineering Program, which teaches it with notes, a hands-on lab and an exam. The first lesson is free.