Popular GitHub Repositories for Local Llm

Harness LLMs with Multi-Agent Programming

Free, high-quality text-to-speech API endpoint to replace OpenAI, Azure, or ElevenLabs

A simple "Be My Eyes" web app with a llama.cpp/llava backend

Run AI ? assistant locally! with simple API for Node.js ?

Chrome Extension to Summarize or Chat with Web Pages/Local Documents Using locally running LLMs. Keep all of your data and conversations private. ?

Code with AI in VSCode, bring your own ai.

Your fully proficient, AI-powered and local chatbot assistant?

A simple, intuitive toolkit for quickly implementing LLM powered applications.

A python package for developing AI applications with local LLMs.

LLM story writer with a focus on high-quality long output based on a user provided prompt.

Openai-style, fast & lightweight local language model inference w/ documents

A simple experiment on letting two local LLM have a conversation about anything!

Run Open Source/Open Weight LLMs locally with OpenAI compatible APIs

Recipes for on-device voice AI and local LLM

Run local LLM from Huggingface in React-Native or Expo using onnxruntime.

Python library for the instruction and reliable validation of structured outputs (JSON) of Large Language Models (LLMs) with Ollama and Pydantic. -> Deterministic work with LLMs.

PalmHill.BlazorChat is a chat application and API built with Blazor WebAssembly, SignalR, and WebAPI, featuring real-time LLM conversations, markdown support, customizable settings, and a responsive design. This project supports Llama2 models and was tested with Orca2.

A lo-fi AI-first note taker running locally on-device

Structured inference with Llama 2 in your browser

Infinite Craft but in Pyside6 and Python with local LLM (llama3 & others) using Ollama