LMSYS Chatbot Arena

An online chatbot arena where the performance of different language models is compared.

InternationalSelectionchattingChatbotLanguage Model

The LMSYS Chatbot Arena is an online platform aimed at conducting benchmark tests on large language models (LLMs) through interactions with anonymous chatbot models. The platform has accumulated over 700,000 human votes, calculating LLMs' Elo rankings to determine the champions in the chatbot field. The platform offers a research preview with limited security measures, which may generate inappropriate content, thus requiring users to adhere to specific terms of use.

Engage in conversations with two anonymous chatbot models.
Vote for the responses from the two models
choosing the better one.
Continue the conversation until the user identifies the winner.
Voting will not be counted if the model identity is revealed during the conversation.
View and compare descriptions of 41 different models.
Share conversation results.
Regenerate conversations for new comparisons.

Researchers and Developers: Utilize this platform to test and compare the performance of various language models.
General Users: Experience and understand the conversational abilities of current language models.
Educators: Use as a teaching tool to showcase the application of language models in real conversations.

Researchers use the LMSYS Chatbot Arena to assess the performance of different models on specific tasks.
General users get to know the personalities and answer styles of different chatbots through the platform.
Educators demonstrate in class how to use the LMSYS Chatbot Arena to compare language models.

Visit the LMSYS Chatbot Arena website.
Select two anonymous models for conversation.
Ask questions and observe the responses from the two models.
Vote for the responses from the two models
choosing the one you think is better.

Visit

LMSYS Chatbot Arena Visit Over Time

Monthly Visits

184958

Bounce Rate

85.21%

Page per Visit

1.2

Visit Duration

00:00:38

LMSYS Chatbot Arena Visit Trend

LMSYS Chatbot Arena Visit Geography

LMSYS Chatbot Arena Traffic Sources

LMSYS Chatbot Arena Alternatives

INTELLECT-1 Chat — A 10 billion parameter language model chat tool trained through global collaboration.

chatting•Artificial Intelligence•Language Model

OLMo-2-1124-13B-DPO — High-performance English language model suitable for diverse tasks.

Programming•Language Model•Natural Language Processing

OLMo 2 — State-of-the-art fully open language model

Programming•Language Model•Natural Language Processing

Lingma SWE-GPT — An open-source large language model specifically designed for software improvement.

Programming•Open Source•Artificial Intelligence

Spirit LM — Multimodal language model that integrates text and speech

Productivity•Multimodal•Language Model

ChatGPT (Early Version for Plus, Team, Enterprise, and Edu) — The early version of ChatGPT, designed specifically for Plus, Team, Enterprise, and Education users.

chatting•Artificial Intelligence•Chatbot

324

o1 in Medicine — Preliminary Research of AI in Medicine

Education•Artificial Intelligence•Medicine

SFR-Judge — An intelligent evaluation tool that accelerates model assessment and fine-tuning.

Productivity•Artificial Intelligence•Evaluation Tool

Chub — A universal artificial intelligence platform for everyone.

Productivity•Artificial Intelligence•Chatbot

186

JanitorAI — A platform offering a diverse range of chatbots.

210

Grok-2 — A cutting-edge language model with advanced reasoning capabilities.

InternationalSelection•Language Model•Reasoning

1014

IncarnaMind — Engage in conversations with your documents using large language models like GPT.

Productivity•Machine Learning•PDF

156

Gemma-2-9B-Chinese-Chat — Multifunctional Chinese-English Dialogue Model

chatting•Artificial intelligence•Language model

432

LLM Comparator — Compares the output of various large language models (LLMs)

Productivity•Artificial Intelligence•Language Models

426

Refuel LLM-2 — An advanced language model designed for data annotation, cleaning, and enrichment.

Productivity•Data Annotation•Language Model

234

MAP-NEO — MAP-NEO is an entirely open-source large language model offering advanced natural language processing capabilities.

Programming•Natural Language Processing•Open Source

438

gpt2-chatbot — An advanced chat model based on the GPT-4 architecture, offering a high-quality conversation experience.

InternationalSelection•Language Model•Dialogue System

1626

LLaVA++ — LLaVA++ extends the LLaVA model by integrating Phi-3 and LLaMA-3, enhancing the interaction capability between visual and language models.

Programming•Artificial Intelligence•Natural Language Processing

468

ChatGPT Online ChatGPTXOnline — ChatGPT Online is a version of ChatGPT that can be accessed directly through a web browser without the need for registration or login. It allows you to interact with an AI assistant in an interactive chat format without installing any additional software.

chatting•Chat•Artificial Intelligence

540

Tipsy — In the Tipsy Chat saloon, unlimited imagination will bring your deepest desires to life.

chatting•Artificial Intelligence•Chatbot

3468

Tiangong AI Assistant — A versatile AI assistant that can search, chat, write, and paint, offering endless possibilities.

ChineseSelection•Artificial Intelligence•Search

3834

KaraboAI — Create custom AI chatbots for your business.

chatting•Chatbot•Artificial Intelligence

528

StarryAI TeleChat — StarryAI, the intelligent dialogue assistant

chatting•Artificial intelligence•Natural Language Processing

552

Chatbot Arena — A popular chatbot building tool.