OpenCompass Multi-modal Leaderboard

Real-time updated leaderboard of multi-modal model performance

CommonProductProductivityMulti-modalPerformance Evaluation

The OpenCompass multi-modal leaderboard is a real-time platform for evaluating and ranking different multi-modal models (VLMs). It calculates the average score of models based on 8 multi-modal benchmarks and provides detailed performance data. The platform only includes open-source VLMs or publicly available APIs, aiming to help researchers and developers understand the latest advancements and performance of current multi-modal models.

Provide real-time ranking and performance data for multi-modal models
Support adding new models to VLMEvalKit by creating PRs
Performance evaluation using 8 multi-modal benchmarks
Provide detailed model performance reports including scores for each benchmark
Allow users to obtain help and support by contacting the email address opencompass@pjlab.org.cn

This leaderboard is suitable for researchers
developers
and enterprise decision-makers in the field of artificial intelligence because it provides a transparent and impartial platform to evaluate and compare the performance of different multi-modal models. This helps them choose the most suitable model for their project requirements or understand industry trends and development directions.

Researchers use the leaderboard to compare the performance of different models on specific tasks
Developers leverage leaderboard data to select models suitable for their application scenarios
Enterprise decision-makers refer to the leaderboard to formulate technology procurement or R&D strategies

Visit the OpenCompass multi-modal leaderboard website
View the current ranking and performance data for multi-modal models
Click on a model of interest to obtain a more detailed performance report
Visit VLMEvalKit and create a PR to add new models if needed
Get further assistance and support through the contact information provided on the leaderboard

Visit

OpenCompass Multi-modal Leaderboard Visit Over Time

Monthly Visits

32337

Bounce Rate

33.35%

Page per Visit

3.0

Visit Duration

00:02:12

OpenCompass Multi-modal Leaderboard Visit Trend

OpenCompass Multi-modal Leaderboard Visit Geography

OpenCompass Multi-modal Leaderboard Traffic Sources

OpenCompass Multi-modal Leaderboard Alternatives

SEED-Story — Multi-modal Long-form Story Generation Model

Productivity•Artificial Intelligence•Multi-modal

222

Video-MME — The first comprehensive benchmark for evaluating the performance of Multi-Modal Large Language Models (MLLMs) in video analysis.

Video•Multi-modal•Video Analysis

450

Aya Expanse 32B — A multilingual large language model supporting 23 languages

Productivity•multilingual•text generation

LongVU — Spatiotemporal Adaptation Compression Model for Long Video Language Understanding

Video•Video Understanding•Spatiotemporal Compression

genmoai — Open-source video generation model

Video•Video Generation•Artificial Intelligence

Act-One — Generate expressive character performances using simple video input

Video•Artificial Intelligence•Machine Learning

234

RoboticsDiffusionTransformer — A diffusion-based model designed for bimanual manipulation.

Programming•Robotics•Artificial Intelligence

AI Directory — A directory of the world's leading artificial intelligence companies

Business•Artificial Intelligence•Machine Learning

Llama-3.2-3B — Multilingual Large Language Model

Productivity•Artificial Intelligence•Machine Learning

174

Llama 3.2 — Open-source AI model that can be fine-tuned, distilled, and deployed.

Productivity•Machine Learning•Open Source

162

Intel Gaudi 3 AI Accelerator — High-performance AI accelerator designed for AI workloads.

Others•Artificial Intelligence•Accelerator

YunHu Ai — An AI assistant that creates limitless possibilities.

ChineseSelection•Artificial Intelligence•Chat Assistant

SmartDialogue — Explore unlimited intelligence and build a more perfect path of aggregation.

chatting•Artificial Intelligence•Natural Language Processing

426

GRIN-MoE — High-performance, low-resource consumption hybrid expert model

Programming•Artificial Intelligence•Machine Learning

FlyCode — Utilize AI to optimize subscription revenue and reduce customer churn.

Business•Subscription Revenue Optimization•Payment Retry

138

OmniGen — A unified framework for image generation that simplifies multi-task image generation.

Image•Image Generation•Diffusion Models

180

Mistral-Small-Instruct-2409 — High-performance instruct-tuned AI model

Programming•Artificial Intelligence•Natural Language Processing

xAI — AI to Accelerate Human Scientific Discovery

DeepMind — A leading artificial intelligence research company under Google

270

Shangchen Zhou — A blog website focused on research and innovation in the fields of computer vision and machine learning.

OpenSource•Computer Vision•Machine Learning

MemoRAG — A memory-based RAG framework for general-purpose applications

Programming•Natural Language Processing•Machine Learning

SuperPrompt — Aimed at helping us understand the engineering of AI agents through prompt design.