llama-cpp-provider

A self-hosted, offline, ChatGPT-like chatbot. Powered by Llama 2. 100% private, with no data leaving your device. New: Code Llama support!

A C#/.NET library to run LLM (?LLaMA/LLaVA) on your local device efficiently.

Run AI models locally on your machine with node.js bindings for llama.cpp. Enforce a JSON schema on the model output on the generation level

llama.go is like llama.cpp in pure Golang!

Create characters in Unity with LLMs!

Self-evaluating interview for AI coders

? Helix is a private GenAI stack for building AI applications with declarative pipelines, knowledge (RAG), API bindings, and first-class testing.

React Native binding of llama.cpp

Run AI ? assistant locally! with simple API for Node.js ?

LLama.cpp rust bindings