Improving-Accuracy-of-LLM-Applications

A framework for few-shot evaluation of language models.

The LLM Evaluation Framework

Data-Driven Evaluation for LLM-Powered Applications

Metrics to evaluate the quality of responses of your Retrieval Augmented Generation (RAG) applications.

AgentLab: An open-source framework for developing, testing, and benchmarking web agents on diverse tasks, designed for scalability and reproducibility.

Python SDK for running evaluations on LLM generated responses

DevQualityEval: An evaluation benchmark ? and framework to compare and evolve the quality of code generation of LLMs.

Test and evaluate LLMs and model configurations, across all the scenarios that matter for your application

Evaluation suite for large-scale language models.

Multilingual Large Language Models Evaluation Benchmark