llmd

GPT4All: Run Local LLMs on Any Device. Open-source and available for commercial use.

A high-throughput and memory-efficient inference and serving engine for LLMs

Making large AI models cheaper, faster and more accessible

Port of OpenAI's Whisper model in C/C++

DeepSpeed is a deep learning optimization library that makes distributed training and inference easy, efficient, and effective.

ncnn is a high-performance neural network inference framework optimized for the mobile platform

Find secrets with Gitleaks ?

本项目旨在分享大模型相关技术原理以及实战经验（大模型工程化、大模型应用落地）

Machine Learning Engineering Open Book

? The exhaustive Pattern Matching library for TypeScript, with smart type inference.