AI engineering glossary · Agents tools MCP
What is agent benchmark?
Agent benchmark: A standard set of tasks and scoring rules used to compare agents, such as fixing real software issues or completing web tasks. Benchmarks allow comparison but may not reflect a team's own tasks, so custom tests are still needed.
Agent benchmark: an example
SWE-bench gives an agent real GitHub issues and checks whether its code change makes the project's tests pass.
Related terms
More Agents tools MCP terms
- Agent card
- Agent evaluation
- Agent handoff
- Agent loop
- Agent memory
- Agent observability
- Agent skills
- Agent trace
Where you learn it
Agent benchmark is part of the AI Engineering Program, which teaches it with notes, a hands-on lab and an exam. The first lesson is free.