Popular GitHub Repositories for Llm Ops

Run any open-source LLMs, such as DeepSeek and Llama, as OpenAI compatible API endpoint in the cloud.

Serverless AI Workflows for Data & ML Teams

RAG (Retrieval Augmented Generation) Framework for building modular, open source applications for production by TrueFoundry

AutoRAG: An Open-Source Framework for Retrieval-Augmented Generation (RAG) Evaluation & Optimization with AutoML-Style Automation

AIConfig is a config-based framework to build generative AI applications.

Python SDK for running evaluations on LLM generated responses

An end-to-end LLM reference implementation providing a Q&A interface for Airflow and Astronomer

Friendli: the fastest serving engine for generative AI

Streamlit-based chatbot leveraging Ollama via LangChain and PostHog-LLM for advanced logging and monitoring

Lightweight Agent Framework for building AI apps with any LLM

LLM-ML-Observability Toolkits and Serivces

Deploy an AI-powered chatbot for your repo in under 2 minutes.

An AI Agent IaC tool that aims to make developing and deploying AI Agents easier.