eval-al

Supercharge Your LLM Application Evaluations ?

Vowpal Wabbit is a machine learning system which pushes the frontier of machine learning with techniques such as online, hashing, allreduce, reductions, learning2search, active, and interactive learning.

OpenCompass is an LLM evaluation platform, supporting a wide range of models (Llama3, Mistral, InternLM2,GPT-4,LLaMa2, Qwen,GLM, Claude, etc) over 100+ datasets.

AutoRAG: An Open-Source Framework for Retrieval-Augmented Generation (RAG) Evaluation & Optimization with AutoML-Style Automation

The easiest tool for fine-tuning LLM models, synthetic data generation, and collaborating on datasets.

SuperCLUE: 中文通用大模型综合性基准 | A Benchmark for Foundation Models in Chinese

A unified evaluation framework for large language models

An open-source visual programming environment for battle-testing prompts to LLMs.

Accelerating the development of large multimodal models (LMMs) with one-click evaluation module - lmms-eval.

A modular active learning framework for Python