autoevaluator

A framework for few-shot evaluation of language models.

The LLM Evaluation Framework

[CVPR2024 Highlight] VBench - We Evaluate Video Generation

Data-Driven Evaluation for LLM-Powered Applications

AgentLab: An open-source framework for developing, testing, and benchmarking web agents on diverse tasks, designed for scalability and reproducibility.

Metrics to evaluate the quality of responses of your Retrieval Augmented Generation (RAG) applications.

Python SDK for running evaluations on LLM generated responses

[NeurIPS 2024 D&B Spotlight?] ChronoMagic-Bench: A Benchmark for Metamorphic Evaluation of Text-to-Time-lapse Video Generation

DevQualityEval: An evaluation benchmark ? and framework to compare and evolve the quality of code generation of LLMs.

Test and evaluate LLMs and model configurations, across all the scenarios that matter for your application