Chatbot Arena

Chatbot Arena is one of the most widely referenced public benchmarks in the AI field — a platform where anyone can send a message and see two anonymous models respond, then vote for which response they prefer. Over millions of such comparisons, models accumulate Elo scores that represent their standing relative to each other in real-world, user-generated conversations. Because the inputs are real (not curated by researchers) and the voters are real users (not trained annotators), Chatbot Arena captures a different dimension of model quality than academic benchmarks. For behavior architects, it’s a useful external signal for understanding how a model performs relative to the field — though its generalist user population means it may not reflect the specific use case or audience of a given product.