LMSYS Chatbot Arena Leaderboard

A crowdsourced open platform for evaluating the performance of Large Language Models (LLMs)

CommonProductProductivityLarge Language Model (LLM)Natural Language Processing (NLP)

The LMSys Chatbot Arena Leaderboard is a crowdsourced open platform for evaluating the performance of Large Language Models (LLMs). It utilizes the Elo ranking system to rank LLMs based on the results of over 300,000 user votes. Users can interact with different LLMs on the website and vote on their conversational quality. This leaderboard can be used to track the development trends of different LLMs and provide benchmark testing tools for researchers and developers.

Compare the performance of different Large Language Models (LLMs)
Conduct objective evaluations using the Elo ranking system
Provide a platform for users to interact with different LLMs
Collect user voting data to continuously update the leaderboard

The LMSys Chatbot Arena Leaderboard can be used for the following purposes: * Researchers and developers can use this platform to evaluate and compare the performance of different LLMs and track their development trends. * Businesses can utilize the leaderboard to select the best-performing LLM for developing chatbots or other AI applications. * General users can use the platform to experience the functionalities of different LLMs and participate in LLM performance evaluation.

Users can find the highest-performing LLMs on the leaderboard and engage in conversations with them to experience their chat and text generation capabilities.
Researchers can compare the performance of different LLMs on various tasks
such as question answering and summarization generation.
Developers can leverage the leaderboard to select the LLM that best suits their application needs.

Visit

LMSYS Chatbot Arena Leaderboard Visit Over Time

Monthly Visits

17104189

Bounce Rate

44.67%

Page per Visit

5.5

Visit Duration

00:05:49

LMSYS Chatbot Arena Leaderboard Visit Trend

LMSYS Chatbot Arena Leaderboard Visit Geography

LMSYS Chatbot Arena Leaderboard Traffic Sources

LMSYS Chatbot Arena Leaderboard Alternatives

OpenCompass Multi-modal Leaderboard — Real-time updated leaderboard of multi-modal model performance

Productivity•Multi-modal•Performance Evaluation

354

FlyCode — Utilize AI to optimize subscription revenue and reduce customer churn.

Business•Subscription Revenue Optimization•Payment Retry

108

DeepLearning.AI — A platform offering professional courses and resources in the field of AI.

InternationalSelection•Machine Learning•Deep Learning

GVHMR — Human motion recovery based on gravity perspective coordinates to restore world positioning.

Image•Human Motion Recovery•Computer Vision

Copilot in Excel — Copilot in Excel: Unlocking data-driven decision-making.

Productivity•Data Analysis•Automation

OmniGen — A unified framework for image generation that simplifies multi-task image generation.

Image•Image Generation•Diffusion Models

Mistral-Small-Instruct-2409 — High-performance instruct-tuned AI model

Programming•Artificial Intelligence•Natural Language Processing

Qwen2.5-LLM — An open-source high-performance language model that supports multi-platform applications.

Productivity•Natural Language Processing•Machine Learning

ViewCrafter — Video diffusion model for high-fidelity new viewpoint synthesis

Image•3D Reconstruction•Video Synthesis

xAI — AI to Accelerate Human Scientific Discovery

DeepMind — A leading artificial intelligence research company under Google

1X World Model — An advanced world model providing virtual simulation and evaluation for robotics.

Productivity•Machine Learning•Virtual Simulation

Pixtral 12B — The first multimodal Mistral model, supporting hybrid task processing for images and text.

Productivity•Multimodal•AI Model

Shangchen Zhou — A blog website focused on research and innovation in the fields of computer vision and machine learning.

OpenSource•Computer Vision•Machine Learning

Skywork-Reward-Llama-3.1-8B — An advanced reward model for text classification and preference assessment.

Programming•Machine Learning•Natural Language Processing

seed-vc — Zero-shot voice conversion technology that achieves high-fidelity transformation of quality and tone.

Programming•Voice Conversion•Zero-shot Learning

114

pixtral-12b-240910 — A multimodal large language model that supports understanding of both images and text.

Image•Multimodal•Image Processing

MemoRAG — A memory-based RAG framework for general-purpose applications

Programming•Natural Language Processing•Machine Learning

finegrain-object-cutter — Fine-grained object cutting tool for precise image editing.

Image•Image Editing•Machine Learning

Qihoo-T2X — Qihoo-T2X, an efficient diffusion transformer model aimed at text-to-any-task processing.

Programming•Text Processing•Diffusion Transformer

SuperPrompt — Aimed at helping us understand the engineering of AI agents through prompt design.

Programming•Artificial Intelligence•Machine Learning

rStar — Enhances problem-solving capabilities of small language models through self-play mutual reasoning.