ax-llm

Get up and running with Llama 3.3, DeepSeek-R1, Phi-4, Gemma 3, and other large language models.

Finetune Llama 3.3, DeepSeek-R1 & Reasoning LLMs 2x faster with 70% less memory! ?

WasmEdge is a lightweight, high-performance, and extensible WebAssembly runtime for cloud native, edge, and decentralized applications. It powers serverless apps, embedded functions, microservices, smart contracts, and IoT devices.

? A fast WebAssembly interpreter and the most universal WASM runtime

Kubernetes Native Edge Computing Framework (project under CNCF)

Efficient Triton Kernels for LLM Training

Nexa SDK is a comprehensive toolkit for supporting GGML and ONNX models. It supports text generation, image generation, vision-language models (VLM), Audio Language Model, auto-speech-recognition (ASR), and text-to-speech (TTS) capabilities.

Event-driven Infrastructure for Modern Cloud

Everything about federated learning, including research papers, books, codes, tutorials, videos and beyond

TinyML AI inference library