liteLLM

An open-source library that simplifies LLM completion and embedding calls.

CommonProductProductivityDevelopment ToolsNatural Language Processing

liteLLM is an open-source library designed to simplify LLM completion and embedding calls. It integrates APIs from multiple platforms including Azure, Anthropic, OpenAI, Cohere, and Replicate, allowing you to easily call them with one function. LiteLLM provides convenient interfaces and a consistent output format, making it easier to use LLM models. It can be used in various scenarios such as natural language processing, text generation, and chatbot systems.

Call Azure's LLM completion and embedding APIs
Call Anthropic's LLM completion and embedding APIs
Call OpenAI's LLM completion and embedding APIs
Call Cohere's LLM completion and embedding APIs
Call Replicate's LLM completion and embedding APIs

liteLLM can be used in various scenarios
including natural language processing
text generation
and chatbot systems.

Visit

liteLLM Visit Over Time

Monthly Visits

154539

Bounce Rate

42.26%

Page per Visit

2.7

Visit Duration

00:02:06

liteLLM Visit Trend

liteLLM Visit Geography

liteLLM Traffic Sources

liteLLM Alternatives

llmc — A local inference command-line tool that converts natural language descriptions into executable shell commands.

Programming•Command-Line Tool•Natural Language Processing

Meta-spirit-lm — An advanced model for natural language processing.

Programming•Natural Language Processing•Text Generation

Knowledge Table — An open-source tool that simplifies the extraction and exploration of structured data from unstructured documents.

Programming•Natural Language Processing•Data Extraction

198

Zamba2-7B — High-performance small language model

Productivity•Language Model•Natural Language Processing

126

LightRAG — A simple and fast retrieval-augmented generation model

Programming•Natural Language Processing•Retrieval-Augmented Generation

120

TurboSeek — An open-source AI search engine powered by Together.ai.

Productivity•AI Search Engine•Natural Language Processing

174

Chat with your Database — Interact with your database using natural language to query data.

Productivity•Database•Query

126

falcon-mamba-7b — A high-performance causal language model with 7 billion parameters.

Productivity•Causal Language Model•Natural Language Processing

SLM_Survey — Research, Measurement, and Insights on Small Language Models

Education•Small Language Models•Transformer

Entropy-based Sampling — Entropy-based sampling technique that optimizes the diversity and accuracy of model outputs

Programming•Machine Learning•Natural Language Processing

AI Sentence Generator — An online tool that utilizes AI technology to generate high-quality sentences

Writing•AI Writing•Natural Language Processing

162

DataGemma RIG — A text model designed for retrieving and generating content that integrates statistical data.

Others•Text Generation•Natural Language Processing

Reflection Llama-3.1 70B — The world's leading open-source large language model

Productivity•Large Language Model•Natural Language Processing

294

OLMoE — An open-source expert mixture language model with 130 million active parameters.

Productivity•Natural Language Processing•Expert Mixture Model

Awesome ChatGPT Prompts — A collection of prompts for interacting with the ChatGPT model

Productivity•ChatGPT•Artificial Intelligence

108

RWKV v6 Finch 14B — RWKV v6 Finch 14B is an open-source large model that efficiently processes long texts.

Productivity•Artificial Intelligence•Natural Language Processing

204

OpenVoiceChat — Engage in natural voice conversations with large language models.

chatting•Speech Recognition•Text-to-Speech

264

fact-finder — An intelligent question-answering system based on knowledge graphs.

Programming•Intelligent Q&A•Knowledge Graph

132

1.5-Pints — A compact large language model pre-trained in 9 days

Programming•Open Source•Machine Learning

156

speech-to-speech — Open-source speech-to-speech conversion module

Programming•Speech Recognition•Natural Language Processing

516

llama3-s — An open-source language model currently being trained, equipped with 'hearing' capabilities.

Programming•Natural Language Processing•Machine Learning

WeST — Implement speech transcription based on LLM in just 300 lines of code.