Popular GitHub Repositories for Llamacpp

Your AI second brain. Self-hostable. Get answers from the web or your docs. Build custom agents, schedule automations, do deep research. Turn any online or local LLM into your personal, autonomous AI (gpt, claude, gemini, llama, qwen, mistral). Get started - free.

Jan is an open source alternative to ChatGPT that runs 100% offline on your computer

Unified framework for building enterprise RAG pipelines with small, specialized models

A self-hosted, offline, ChatGPT-like chatbot. Powered by Llama 2. 100% private, with no data leaving your device. New: Code Llama support!

A web interface for chatting with Alpaca through llama.cpp. Fully dockerized, with an easy to use API.

Your agent in your terminal, equipped with local tools: writes code, uses the terminal, browses the web, vision.

A C#/.NET library to run LLM (?LLaMA/LLaVA) on your local device efficiently.

AGiXT is a dynamic AI Agent Automation Platform that seamlessly orchestrates instruction management and complex task execution across diverse AI providers. Combining adaptive memory, smart features, and a versatile plugin system, AGiXT delivers efficient and comprehensive AI solutions.

LSP-AI is an open-source language server that serves as a backend for AI-powered functionality, designed to assist and empower software engineers, not replace them.

Local AI API Platform

Instant, controllable, local pre-trained AI models in Rust

Replace OpenAI GPT with another LLM in your app by changing a single line of code. Xinference gives you the freedom to use any LLM you need. With Xinference, you're empowered to run inference with any open-source language models, speech recognition models, and multimodal models, whether in the cloud, on-premises, or even on your laptop.

Chat with your favourite LLaMA models in a native macOS app

The goal of RamaLama is to make working with AI boring.

Calculate token/s & GPU memory requirement for any LLM. Supports llama.cpp/ggml/bnb/QLoRA quantization

The TypeScript library for building AI applications.

A FastAPI service for semantic text search using precomputed embeddings and advanced similarity measures, with built-in support for various file types through textract.

The easiest way to use the Ollama API in .NET

Believe in AI democratization. llama for nodejs backed by llama-rs, llama.cpp and rwkv.cpp, work locally on your laptop CPU. support llama/alpaca/gpt4all/vicuna/rwkv model.

LSP server leveraging LLMs for code completion (and more?)