Popular GitHub Repositories for Ai Infra

? Awesome System for Machine Learning ⚡️ AI System Papers and Industry Practice. ⚡️ System for Machine Learning, LLM (Large Language Model), GenAI (Generative AI). ? OSDI, NSDI, SIGCOMM, SoCC, MLSys, etc. ?️ Llama3, Mistral, etc. ?‍? Video Tutorials.

SpargeAttention: A training-free sparse attention that can accelerate any model inference.

This is a landscape of the infrastructure that powers the generative AI ecosystem

Cloud Native ML/DL Platform

A curated list of awesome tools, frameworks, platforms, and resources for building scalable and efficient AI infrastructure, including distributed training, model serving, MLOps, and deployment.