Popular GitHub Repositories for Ai Evaluation

Hallucinations (Confabulations) Document-Based Benchmark for RAG. Includes human-verified questions and answers.

Ranking LLMs on agentic tasks

one click to open multi AI sites ｜ 一键打开多个 AI 站点，查看 AI 结果

Code scanner to check for issues in prompts and LLM calls

Benchmark evaluating LLMs on their ability to create and resist disinformation. Includes comprehensive testing across major models (Claude, GPT-4, Gemini, Llama, etc.) with standardized evaluation metrics.

Cost-of-Pass: An Economic Framework for Evaluating Language Models