Popular GitHub Repositories for Llama Cpp

A self-hosted, offline, ChatGPT-like chatbot. Powered by Llama 2. 100% private, with no data leaving your device. New: Code Llama support!

A C#/.NET library to run LLM (?LLaMA/LLaVA) on your local device efficiently.

Run AI models locally on your machine with node.js bindings for llama.cpp. Enforce a JSON schema on the model output on the generation level

llama.go is like llama.cpp in pure Golang!

Create characters in Unity with LLMs!

Self-evaluating interview for AI coders

React Native binding of llama.cpp

Run AI ? assistant locally! with simple API for Node.js ?

LLama.cpp rust bindings

This repo is to showcase how you can run a model locally and offline, free of OpenAI dependencies.

Local ML voice chat using high-end models.

Run LLMs locally. A clojure wrapper for llama.cpp.

Booster - open accelerator for LLM models. Better inference and debugging for AI hackers

Making offline AI models accessible to all types of edge devices.

LLaMA Server combines the power of LLaMA C++ with the beauty of Chatbot UI.

Your customized AI assistant - Personal assistants on any hardware! With llama.cpp, whisper.cpp, ggml, LLaMA-v2.

InsightSolver: Colab notebooks for exploring and solving operational issues using deep learning, machine learning, and related models.

Langport is a language model inference service

? Local PDF-Integrated Chat Bot: Secure Conversations and Document Assistance with LLM-Powered Privacy

llm-inference is a platform for publishing and managing llm inference, providing a wide range of out-of-the-box features for model deployment, such as UI, RESTful API, auto-scaling, computing resource management, monitoring, and more.