Studying the Frontier: Arena Expert
Arena Expert is a great way to differentiate between frontier models.
In this analysis, we compare how models perform on 'general' vs 'expert' prompts, focusing on 'thinking' vs 'non-thinking' models.
Latest
Research
Studying the Frontier: Arena Expert
Arena Expert is a great way to differentiate between frontier models.
In this analysis, we compare how models perform on 'general' vs 'expert' prompts, focusing on 'thinking' vs 'non-thinking' models.
LMArena's Ranking Method
Arena Expert and Occupational Categories
Re-introducing Vision Arena Categories
Introducing BiomedArena.AI: Evaluating LLMs for Biomedical Discovery
A Deep Dive into Recent Arena Data
Does Sentiment Matter Too?
News
LMArena's Ranking Method
Since launching the platform, developing a rigorous and scientifically grounded evaluation methodology has been central to our mission. A key component of this effort is providing proper statistical uncertainty quantification for model scores and rankings. To that end, we have always reported confidence intervals alongside Arena scores and surfaced any
The Next Stage of AI Coding Evaluation Is Here
