Search AI Products and News

Grok-2 and Grok-Mini, two AI models, perform exceptionally well in the LMSys chatbot leaderboard. Grok-2 has surpassed GPT-4o to take the second spot, tying with Gemini, thanks to the votes of over 6,000 users. Grok-2 excels in mathematical tasks and has achieved second place in several other tasks. Grok-2-Mini enters the rankings at fifth place, demonstrating impressive capabilities, and has achieved a speed increase, running twice as fast as before. This improvement is attributed to enhanced reasoning.

Google has released its latest AI masterpiece, Gemini 1.5 Pro, offering an experimental version 0801 through Google AI Studio and the Gemini API. This model leads the LMSYS leaderboard with an ELO score of 1300, surpassing OpenAI's GPT-4o and Anthropic's Claude-3.5 Sonnet. Gemini 1.5 Pro excels in multilingual tasks, mathematics, coding, and visual tasks, featuring a context window of 2 million tokens.

The latest data from the LMSYS chatbot arena ranking shows that Gemini-1.5-Pro ranks first in Japanese, Chinese, and French, demonstrating strong multilingual capabilities. Meanwhile, GPT-4o performs excellently in English, German, and Spanish, maintaining its top position. Additionally, Claude-3Opus excels in the Russian domain, attracting widespread attention.

The Google Bard GemPro version has successfully surpassed GPT-4 in the LMSYS chatbot rankings, bringing significant changes to the chatbot field. Bard is now the second highest-scoring chatbot on the LMSYS list, gradually catching up to the champion, GPT-4 Turbo. Bard's rise is attributed to its adoption of Google's Gemini Pro large multimodal model, making it the second model on the list to achieve over 1200 points. LMSYS Org states that Bard's surge in the rankings is a remarkable development.