Popular GitHub Repositories for K8s

ClearML - Auto-Magical CI/CD to streamline your AI workload. Experiment Management, Data Management, Pipeline, Orchestration, Scheduling & Serving in one MLOps/LLMOps solution

dstack is a lightweight, open-source alternative to Kubernetes & Slurm, simplifying AI container orchestration with multi-cloud & on-prem support. It natively supports NVIDIA, AMD, TPU, and Intel accelerators.

DLRover: An Automatic Distributed Deep Learning System

LLMs for your CLI

? Kubectl plugin to create manifests with LLMs

AI Inference Operator for Kubernetes. The easiest way to serve ML models in production. Supports VLMs, LLMs, embeddings, and speech-to-text.

Model Deployment at Scale on Kubernetes ??

? Helix is a private GenAI stack for building AI applications with declarative pipelines, knowledge (RAG), API bindings, and first-class testing.

Simple and flexible ML workflow engine

ClearML - Auto-Magical CI/CD to streamline your AI workload. Experiment Management, Data Management, Pipeline, Orchestration, Scheduling & Serving in one MLOps/LLMOps solution

ClearML Agent - ML-Ops made easy. ML-Ops scheduler & orchestration solution

OpenDILab RL Kubernetes Custom Resource and Operator Lib

OpenDILab RL Object Store

Mastering the Art of Scalable and Efficient AI Model Deployment

Machine learning operator & controller for Kubernetes

实践及手册撰写：涵盖DevOps，云原生技术，大数据，人工智能，高并发&高性能&高可用服务等

Extensible generative AI platform on Kubernetes with OpenAI-compatible APIs.

K8s-mcp-server is a Model Context Protocol (MCP) server that enables AI assistants like Claude to securely execute Kubernetes commands. It provides a bridge between language models and essential Kubernetes CLI tools including kubectl, helm, istioctl, and argocd, allowing AI systems to assist with cluster management, troubleshooting, and deployments

Tool to take your ML model from local to production with one-line of code.

Open Infrastructure & Cloud Native Days Korea 2019 - Workshop