Popular GitHub Repositories for Litellm

Evaluate your LLM's response with Prometheus and GPT4 ?

Lightweight LLM Interaction Framework

VividNode: Multi-purpose Text & Image Generation Desktop Chatbot (supporting various models including GPT).

To simplify and streamline LLM operations, empowering developers and organizations to harness the full potential of large language models with ease.

A Discord bot for large language models. Add Gemini, Llama 3.3, DeepSeek R-1, and other models.

? LiteLLM Proxy for Google Cloud Generative AI

LangChain + LiteLLM that works

Sales AI agent that talks with your customers, recommend products, book consultations, and process Stripe payments

SynthGenAI - Package for Generating Synthetic Datasets using LLMs.

Open Server is an OpenAI API Compatible Server for generating text, images, embeddings, and storing them in vector databases. It also includes a chat functionality.

Multi-agent workflows and complex Agent interactions, both via YAML manifest and programmatic usage. Pydantic-AI and LiteLLM backends. Human-in-the-loop integration.

Fill up the `model_list` field in your LiteLLM proxy configuration file

rag-colls - Implement recent advanced RAG techniques

WIP Slack based AI assistant API

Discord chat bot with LLMs API

Build, deploy, and orchestrate AI agents at scale with ease. Swarms API provides a comprehensive suite of endpoints for creating and managing multi-agent systems.

Sample LLM-based chatbot service with local and remote models

A CLI Tool for Local File Translation Using Generative AI

A demo of your own RAG Chatbot with Xata, SvelteKit, LiteLLM, OpenAI and Vercel.

Optimize a prompt for a language model using a genetic algorithm.