Popular GitHub Repositories for Leaderboard

:cloud: :rocket: :bar_chart: :chart_with_upwards_trend: Evaluating state of the art in AI

CogDL: A Comprehensive Library for Graph Deep Learning (WWW 2023)

An automatic evaluator for instruction-following language models. Human-validated, high-quality, cheap, and fast.

Awesome-LLM-Eval: a curated list of tools, datasets/benchmark, demos, leaderboard, papers, docs and models, mainly for Evaluation on LLMs. 一个由工具、基准/数据、演示、排行榜和大模型等组成的精选列表，主要面向基础大模型评测，旨在探求生成式AI的技术边界.

SKAB - Skoltech Anomaly Benchmark. Time-series data for evaluating Anomaly Detection algorithms.

A joint community effort to create one central leaderboard for LLMs.

A curated list of awesome leaderboard-oriented resources for foundation models

Hallucinations (Confabulations) Document-Based Benchmark for RAG. Includes human-verified questions and answers.

A Large-scale Dataset for training and evaluating model's ability on Dense Text Image Generation

Open-LLM-Leaderboard: Open-Style Question Evaluation. Paper at https://arxiv.org/abs/2406.07545

All-in-one UI for merged LLMs in Hugging Face

The most extensive open massively multilingual corpus of datasets for training sentiment models. The corpus consists of 79 manually selected from over 350 datasets reported in the scientific literature based on strict quality criteria and covers 27 languages.

A framework for evaluating the effectiveness of chain-of-thought reasoning in language models.

Evaluating Large Language Models with Grid-Based Game Competitions: An Extensible LLM Benchmark and Leaderboard

Building autonomous driving system by using CARLA simulator

Tools for merging pretrained Large Language Models and create Mixture of Experts (MoE) from open-source models.

? A profile with a custom followers contributions ranking, followers review using AI, and other stuff.

Machine Learning + Multi Agent System for Self Driving

Luna ML - ML Leaderboard for your team with automatic model evaluation

This repository highlights the LLMs reasoning capabilities of ? Mistral / LLaMA-3 / Phi-3 / Gemma / Flan-T5 / GPT-4o ? in Targeted Sentiment Analysis in Russian / Translated to English mass-media ?