genkit-promptfoo-sample

Supercharge Your LLM Application Evaluations ?

A framework for few-shot evaluation of language models.

The LLM Evaluation Framework

OpenCompass is an LLM evaluation platform, supporting a wide range of models (Llama3, Mistral, InternLM2,GPT-4,LLaMa2, Qwen,GLM, Claude, etc) over 100+ datasets.

AutoRAG: An Open-Source Framework for Retrieval-Augmented Generation (RAG) Evaluation & Optimization with AutoML-Style Automation

The easiest tool for fine-tuning LLM models, synthetic data generation, and collaborating on datasets.

SuperCLUE: 中文通用大模型综合性基准 | A Benchmark for Foundation Models in Chinese

A unified evaluation framework for large language models

An open-source visual programming environment for battle-testing prompts to LLMs.

Accelerating the development of large multimodal models (LMMs) with one-click evaluation module - lmms-eval.