Open-LLM-Leaderboard

Debug, evaluate, and monitor your LLM applications, RAG systems, and agentic workflows with comprehensive tracing, automated evaluations, and production-ready dashboards.

The LLM Evaluation Framework

AI Observability & Evaluation

? Open-Source Evaluation & Testing for AI & LLM systems

the LLM vulnerability scanner

AutoRAG: An Open-Source Framework for Retrieval-Augmented Generation (RAG) Evaluation & Optimization with AutoML-Style Automation

The LLM's practical guide: From the fundamentals to deploying advanced LLM and RAG apps to AWS using LLMOps best practices

The open-source LLMOps platform: prompt playground, prompt management, LLM evaluation, and LLM Observability all in one place.

:cloud: :rocket: :bar_chart: :chart_with_upwards_trend: Evaluating state of the art in AI

CogDL: A Comprehensive Library for Graph Deep Learning (WWW 2023)