autoevaluator

A framework for few-shot evaluation of language models.

The LLM Evaluation Framework

[CVPR2024 Highlight] VBench - We Evaluate Video Generation

Data-Driven Evaluation for LLM-Powered Applications

Metrics to evaluate the quality of responses of your Retrieval Augmented Generation (RAG) applications.

AgentLab: An open-source framework for developing, testing, and benchmarking web agents on diverse tasks, designed for scalability and reproducibility.

Python SDK for running evaluations on LLM generated responses

[NeurIPS 2024 D&B Spotlight?] ChronoMagic-Bench: A Benchmark for Metamorphic Evaluation of Text-to-Time-lapse Video Generation

DevQualityEval: An evaluation benchmark ? and framework to compare and evolve the quality of code generation of LLMs.

Test and evaluate LLMs and model configurations, across all the scenarios that matter for your application