AI engineering glossary · RAG vector search
What is LLM-as-judge?
LLM-as-judge: Using a language model to grade another model's outputs against criteria such as faithfulness or relevance. It scales evaluation beyond manual review, though judges have biases and should be checked against human labels.
LLM-as-judge: an example
A judge model reads the context and answer and marks each claim 'supported' or 'unsupported'.
Related terms
More RAG vector search terms
- Locality-sensitive hashing
- M parameter
- Maximal marginal relevance
- Metadata filtering
- Multi-hop retrieval
- Multi-query retrieval
- Multi-tenancy
- Multi-vector retrieval
Where you learn it
LLM-as-judge is part of the AI Engineering Program, which teaches it with notes, a hands-on lab and an exam. The first lesson is free.