AI engineering glossary · Evals guardrails AI security
What is Chatbot Arena?
Chatbot Arena (also called LMArena): A public platform where people chat with two anonymous models side by side, vote for the better answer, and those votes are aggregated into a ranking of models. It captures real user preferences on open-ended prompts that fixed benchmarks miss.
Chatbot Arena: an example
A user asks two hidden models to explain GST filing, prefers the second reply, and that vote nudges the second model's rating up.
Related terms
More Evals guardrails AI security terms
- Citation checking
- Constitutional classifiers
- Content moderation
- Crescendo attack
- Cross-tenant leakage
- Data exfiltration
- Data masking
- Data poisoning
Where you learn it
Chatbot Arena is part of the AI Engineering Program, which teaches it with notes, a hands-on lab and an exam. The first lesson is free.