Popular GitHub Repositories for Llama Cpp Python

Setup and run a local LLM and Chatbot using consumer grade hardware.

Gradio based tool to run opensource LLM models directly from Huggingface

Local character AI chatbot with chroma vector store memory and some scripts to process documents for Chroma

Tool for test diferents large language models without code.

A financial chatbot powered by an LLM and retrieval-augmented generation.

A quick and optimized solution to manage llama based gguf quantized models, download gguf files, retreive messege formatting, add more models from hf repos and more. It's super easy to use and comes prepacked with best preconfigured open source models: dolphin phi-2 2.7b, mistral 7b v0.2, mixtral 8x7b v0.1, solar 10.7b and zephyr 3b

Simple chat interface for local AI using llama-cpp-python and llama-cpp-agent

TAO71 I4.0 is an AI created by TAO71 in Python.

Llama.cpp é uma biblioteca desenvolvida em C++ para a implementação eficiente de grandes modelos de linguagem, como o LLaMA da Meta. Otimizada para rodar em diversas plataformas, incluindo dispositivos com recursos limitados, oferece performance, velocidade de inferência e uso eficiente da memória, essenciais para a execução de grandes. modelos

Genshin Impact Character Chat Models tuned by Lora on LLM

llama-cpp-python(llama.cpp)で実行するGGUF形式のLLM用の簡易Webインタフェースです。

Huginn Hears is a local app that transcribes and summarizes your meetings in Norwegian and English, using state-of-the-art models and open-source libraries. No cloud needed, run everything offline.

Mistral assisted visual instruction data generation by following LLaVA

Local gpt in llama.cpp models with chat interface

A Genshin Impact Question Answer Project supported by Qwen1.5-14B-Chat

Triangulum 10B: Multilingual Large Language Models (LLMs)

A custom framework for easy use of LLMs, VLMs, etc. supporting various modes and settings via web-ui

RuneScript is a cutting-edge scripting platform for developers, combining advanced script execution, version control integration, and an intuitive AI assistant. Empower your coding workflow with seamless automation, powerful tools, and a streamlined development experience inspired by the mystique of runes.

This repository demonstrates how to use outlines and llama-cpp-python for structured JSON generation with streaming output, integrating llama.cpp for local model inference and outlines for schema-based text generation.