Popular GitHub Repositories for Local Ai

Olares: An Open-Source Sovereign Cloud OS for Local AI

MLX-VLM is a package for inference and fine-tuning of Vision Language Models (VLMs) on your Mac using MLX.

A minimal web-UI for talking to Ollama (and OpenAI) servers

MemoryCache is an experimental development project to turn a local desktop environment into an on-device AI agent

Shinkai is a two click install AI manager (Ollama compatible for Windows, Mac and Linux). It lets you download/use AI models, RAG, and performs actions for you with tooling (very soon).

Simplified LLM inference and training on device

Like ChatGPT's voice conversations with an AI, but entirely offline/private/trade-secret-friendly, using local AI models such as LLama 2 and Whisper

Blueprint by Mozilla.ai for generating podcasts from documents using local AI

lcpp is a dart implementation of llama.cpp used by the mobile artificial intelligence distribution (maid)

MVP of an idea using multiple local LLM models to simulate and play D&D

Extract structured data from local or remote LLM models

Empower Your Productivity with Local AI Assistants

Blueprint by Mozilla.ai for finetuning a Speech-To-Text model in your own language

Local Generative AI

Search your favorite websites and chat with them, on your desktop?

A curated guide to running Large Language Models (LLMs) on your own machine. Covers tools like Ollama, LM Studio, LocalAI, GPT4All, and more!

? AI-powered macOS automation framework - Control your Mac with natural language using GPT models. No code needed, just English instructions!

Telegram bot that interacts with the local Ollama ? to answer user messages

Spin up any(almost) llm locally!

Catalog of OCI images for popular open-source or open Large Language Models.