Popular GitHub Repositories for Apple Silicon

Run Stable Diffusion on Mac natively

SHARK Studio -- Web UI for SHARK+IREE High Performance Machine Learning Distribution

A MLX port of FLUX based on the Huggingface Diffusers implementation.

MLX-VLM is a package for inference and fine-tuning of Vision Language Models (VLMs) on your Mac using MLX.

Run LLaMA (and Stanford-Alpaca) inference on Apple Silicon GPUs.

Finetune llama2-70b and codellama on MacBook Air without quantization

A text-to-speech (TTS) and Speech-to-Speech (STS) library built on Apple's MLX framework, providing efficient speech synthesis on Apple Silicon.

SiLLM simplifies the process of training and running Large Language Models (LLMs) on Apple Silicon by leveraging the MLX framework.

Run Stable Diffusion using Core ML on iOS within your Expo & React Native App

A few quick scripts focused on testing TensorFlow/PyTorch/Llama 2 on macOS.

GenAI & agent toolkit for Apple Silicon Mac, implementing JSON schema-steered structured output (3SO) and tool-calling in Python. For more on 3SO: https://huggingface.co/blog/ucheog/llm-power-steering

Rasa on ARM-based Macs (Native/Docker)

MaK(Mac+Kubernetes)llama - Running and orchestrating large language models (LLMs) on Kubernetes with macOS nodes.

This list is tailored for users with Apple Silicon devices interested in experimenting with Large Language Models (LLMs).

Examples for using the SiLLM framework for training and running Large Language Models (LLMs) on Apple Silicon

Kokoro TTS for iOS

Explore machine learning techniques with Gradio interfaces for Stable Diffusion image generation and LoRA text generation with the Apple MLX framework.

Real-time object detection overlay for macOS using YOLO models with smooth tracking, performance monitoring, and configurable settings.

LLM model inference on Apple Silicon Mac using the Apple MLX Framework.