liteLLM

An open-source library that simplifies LLM completion and embedding calls.

CommonProductProductivityDevelopment ToolsNatural Language Processing

liteLLM is an open-source library designed to simplify LLM completion and embedding calls. It integrates APIs from multiple platforms including Azure, Anthropic, OpenAI, Cohere, and Replicate, allowing you to easily call them with one function. LiteLLM provides convenient interfaces and a consistent output format, making it easier to use LLM models. It can be used in various scenarios such as natural language processing, text generation, and chatbot systems.

Call Azure's LLM completion and embedding APIs
Call Anthropic's LLM completion and embedding APIs
Call OpenAI's LLM completion and embedding APIs
Call Cohere's LLM completion and embedding APIs
Call Replicate's LLM completion and embedding APIs

liteLLM can be used in various scenarios
including natural language processing
text generation
and chatbot systems.

Visit

liteLLM Visit Over Time

Monthly Visits

64916

Bounce Rate

43.70%

Page per Visit

3.5

Visit Duration

00:03:35

liteLLM Visit Trend

liteLLM Visit Geography

liteLLM Traffic Sources

liteLLM Alternatives

OLMoE-1B-7B — An efficient open-source large language model.

Productivity•Large Language Model•Open Source

gemma-2-9b — Lightweight, advanced text generation model

Productivity•Text Generation•Natural Language Processing

DataGemma RIG — A text model designed for retrieving and generating content that integrates statistical data.

Others•Text Generation•Natural Language Processing

Reflection Llama-3.1 70B — The world's leading open-source large language model

Productivity•Large Language Model•Natural Language Processing

264

OLMoE — An open-source expert mixture language model with 130 million active parameters.

Productivity•Natural Language Processing•Expert Mixture Model

Awesome ChatGPT Prompts — A collection of prompts for interacting with the ChatGPT model

Productivity•ChatGPT•Artificial Intelligence

RWKV v6 Finch 14B — RWKV v6 Finch 14B is an open-source large model that efficiently processes long texts.

Productivity•Artificial Intelligence•Natural Language Processing

162

OpenVoiceChat — Engage in natural voice conversations with large language models.

chatting•Speech Recognition•Text-to-Speech

204

fact-finder — An intelligent question-answering system based on knowledge graphs.

Programming•Intelligent Q&A•Knowledge Graph

1.5-Pints — A compact large language model pre-trained in 9 days

Programming•Open Source•Machine Learning

144

speech-to-speech — Open-source speech-to-speech conversion module

Programming•Speech Recognition•Natural Language Processing

432

llama3-s — An open-source language model currently being trained, equipped with 'hearing' capabilities.

Programming•Natural Language Processing•Machine Learning

WeST — Implement speech transcription based on LLM in just 300 lines of code.

Programming•Speech Recognition•Natural Language Processing

Gemma 2 2B — Lightweight, advanced 2B parameter text generation model.

Productivity•Text Generation•Natural Language Processing

126

Agents 2.0 — Open-source framework supporting data-driven adaptive language agents.

Programming•Open Source•Natural Language Processing

RecurrentGPT — A model for interactive generation of text of any length.

Productivity•Text Generation•Natural Language Processing

120

RWKV — The new generation of large-scale model architecture, surpassing transformer.

Productivity•Open Source•Deep Learning

114

Gemma-2-27b — A lightweight, advanced open-weights text generation model

Programming•Text Generation•Natural Language Processing

Gemma-2-9b-it — Lightweight, advanced text generation model

Productivity•Text Generation•Natural Language Processing

Index-1.9B-Pure — A lightweight large language model focused on text generation.

Programming•Text Generation•Natural Language Processing

108

GoMate — A reliable input and trustworthy output system based on the RAG framework

Programming•RAG•Natural Language Processing

276

MDLM — An efficient masked diffusion language model.

Programming•Language Model•Text Generation

YAYI-UIE Information Extraction Large Model — High-quality information extraction model based on massive data

Programming•Information Extraction•Natural Language Processing

432

Mistral-7B-v0.3 — A large language model with an expanded vocabulary.

Productivity•Large Language Model•Text Generation

378

Fugaku-LLM — Fugaku-LLM is an AI model specializing in text generation.

Productivity•Text Generation•Machine Learning

246

Llama-3-Giraffe-70B-Instruct — A 70B parameter large language model with an effective context length of 128k.

Productivity•Artificial Intelligence•Natural Language Processing

150

MAP-NEO — MAP-NEO is an entirely open-source large language model offering advanced natural language processing capabilities.

Programming•Natural Language Processing•Open Source

414

kan-gpt — A pre-trained generative transformer (GPT) language model implemented using Kolmogorov-Arnold networks (KANs).

Programming•Natural Language Processing•Text Generation

138

Granite Code Models — An open-source foundation model designed for code intelligence tasks, supporting 116 programming languages.

Programming•Code Intelligence•Machine Learning

288

Best AI Websites & Tools

liteLLM

liteLLM Visit Over Time

liteLLM Visit Trend

liteLLM Visit Geography

liteLLM Traffic Sources

liteLLM Alternatives

OLMoE-1B-7B — An efficient open-source large language model.

gemma-2-9b — Lightweight, advanced text generation model

DataGemma RIG — A text model designed for retrieving and generating content that integrates statistical data.

Reflection Llama-3.1 70B — The world's leading open-source large language model

OLMoE — An open-source expert mixture language model with 130 million active parameters.

Awesome ChatGPT Prompts — A collection of prompts for interacting with the ChatGPT model

RWKV v6 Finch 14B — RWKV v6 Finch 14B is an open-source large model that efficiently processes long texts.

OpenVoiceChat — Engage in natural voice conversations with large language models.

fact-finder — An intelligent question-answering system based on knowledge graphs.

1.5-Pints — A compact large language model pre-trained in 9 days

speech-to-speech — Open-source speech-to-speech conversion module

llama3-s — An open-source language model currently being trained, equipped with 'hearing' capabilities.

WeST — Implement speech transcription based on LLM in just 300 lines of code.

Gemma 2 2B — Lightweight, advanced 2B parameter text generation model.

Agents 2.0 — Open-source framework supporting data-driven adaptive language agents.

RecurrentGPT — A model for interactive generation of text of any length.

RWKV — The new generation of large-scale model architecture, surpassing transformer.

Gemma-2-27b — A lightweight, advanced open-weights text generation model

Gemma-2-9b-it — Lightweight, advanced text generation model

Index-1.9B-Pure — A lightweight large language model focused on text generation.

GoMate — A reliable input and trustworthy output system based on the RAG framework

MDLM — An efficient masked diffusion language model.

YAYI-UIE Information Extraction Large Model — High-quality information extraction model based on massive data

Mistral-7B-v0.3 — A large language model with an expanded vocabulary.

Fugaku-LLM — Fugaku-LLM is an AI model specializing in text generation.

Llama-3-Giraffe-70B-Instruct — A 70B parameter large language model with an effective context length of 128k.

MAP-NEO — MAP-NEO is an entirely open-source large language model offering advanced natural language processing capabilities.

kan-gpt — A pre-trained generative transformer (GPT) language model implemented using Kolmogorov-Arnold networks (KANs).

Granite Code Models — An open-source foundation model designed for code intelligence tasks, supporting 116 programming languages.