Popular GitHub Repositories for K8s

ClearML - Auto-Magical CI/CD to streamline your AI workload. Experiment Management, Data Management, Pipeline, Orchestration, Scheduling & Serving in one MLOps/LLMOps solution

dstack is a lightweight, open-source alternative to Kubernetes & Slurm, simplifying AI container orchestration with multi-cloud & on-prem support. It natively supports NVIDIA, AMD, TPU, and Intel accelerators.

DLRover: An Automatic Distributed Deep Learning System

LLMs for your CLI

? Kubectl plugin to create manifests with LLMs

AI Inference Operator for Kubernetes. The easiest way to serve ML models in production. Supports VLMs, LLMs, embeddings, and speech-to-text.

Model Deployment at Scale on Kubernetes ??

? Helix is a private GenAI stack for building AI applications with declarative pipelines, knowledge (RAG), API bindings, and first-class testing.

Simple and flexible ML workflow engine

ClearML - Auto-Magical CI/CD to streamline your AI workload. Experiment Management, Data Management, Pipeline, Orchestration, Scheduling & Serving in one MLOps/LLMOps solution

ClearML Agent - ML-Ops made easy. ML-Ops scheduler & orchestration solution

OpenDILab RL Kubernetes Custom Resource and Operator Lib

一款轻巧、兼容多种系统的迷你 Kubernetes 人工智能控制面板，支持大型模型、智能代理和多集群控制面板（MCP，可自定义操作权限），集成了多集群管理、智能分析和实时异常检测等功能，支持多种架构并可通过单个文件部署，帮助您高效管理和优化 Kubernetes 集群。

OpenDILab RL Object Store

Mastering the Art of Scalable and Efficient AI Model Deployment

Machine learning operator & controller for Kubernetes

实践及手册撰写：涵盖DevOps，云原生技术，大数据，人工智能，高并发&高性能&高可用服务等

Extensible generative AI platform on Kubernetes with OpenAI-compatible APIs.

Tool to take your ML model from local to production with one-line of code.

Open Infrastructure & Cloud Native Days Korea 2019 - Workshop