Popular GitHub Repositories for Ai Infra

? Awesome System for Machine Learning ⚡️ AI System Papers and Industry Practice. ⚡️ System for Machine Learning, LLM (Large Language Model), GenAI (Generative AI). ? OSDI, NSDI, SIGCOMM, SoCC, MLSys, etc. ?️ Llama3, Mistral, etc. ?‍? Video Tutorials.

SpargeAttention: A training-free sparse attention that can accelerate any model inference.

This is a landscape of the infrastructure that powers the generative AI ecosystem

Cloud Native ML/DL Platform

TME：一种结构化内存引擎，用于大型语言模型 (LLM) 代理在多步骤任务中进行规划、回滚和推理。目前正在进行 DAG 升级。

A curated list of awesome tools, frameworks, platforms, and resources for building scalable and efficient AI infrastructure, including distributed training, model serving, MLOps, and deployment.