llmterm

A high-throughput and memory-efficient inference and serving engine for LLMs

Making large AI models cheaper, faster and more accessible

Port of OpenAI's Whisper model in C/C++

DeepSpeed is a deep learning optimization library that makes distributed training and inference easy, efficient, and effective.

OpenAssistant is a chat-based assistant that understands tasks, can interact with third-party systems, and retrieve information dynamically to do so.

Your AI second brain. Self-hostable. Get answers from the web or your docs. Build custom agents, schedule automations, do deep research. Turn any online or local LLM into your personal, autonomous AI (gpt, claude, gemini, llama, qwen, mistral). Get started - free.

ncnn is a high-performance neural network inference framework optimized for the mobile platform

React UI + elegant infrastructure for AI Copilots, AI chatbots, and in-app AI agents. The Agentic last-mile ?

Machine Learning Engineering Open Book

? The exhaustive Pattern Matching library for TypeScript, with smart type inference.