Popular GitHub Repositories for Mlops

A high-throughput and memory-efficient inference and serving engine for LLMs

Learn how to design, develop, deploy and iterate on production-grade ML applications.

Machine Learning Engineering Open Book

A curated list of references for MLOps

Free MLOps course from DataTalks.Club

Run any open-source LLMs, such as DeepSeek and Llama, as OpenAI compatible API endpoint in the cloud.

Example ? Jupyter notebooks that demonstrate how to build, train, and deploy machine learning models using ? Amazon SageMaker.

A booklet on machine learning systems design with exercises. NOT the repo for the book "Designing Machine Learning Systems"

Build, Manage and Deploy AI/ML Systems

The easiest way to serve AI apps and models - Build Model Inference APIs, Job queues, LLM apps, Multi-model pipelines, and more!

Evidently is ??an open-source ML and LLM observability framework. Evaluate, test, and monitor any AI-powered system or data pipeline. From tabular data to Gen AI. 100+ metrics.

This repository is a curated collection of links to various courses and resources about Artificial Intelligence (AI)

ClearML - Auto-Magical CI/CD to streamline your AI workload. Experiment Management, Data Management, Pipeline, Orchestration, Scheduling & Serving in one MLOps/LLMOps solution

The Open Source Feature Store for AI/ML

Superduper: Build end-to-end AI applications and agent workflows on your existing data infrastructure and preferred tools - without migrating your data.

An awesome & curated list of best LLMOps tools for developers

PyTorch Lightning + Hydra. A very user-friendly template for ML experimentation. ???

ZenML ?: The bridge between ML and Ops. https://zenml.io.

An MLOps framework to package, deploy, monitor and manage thousands of production machine learning models

? Open-Source Evaluation & Testing for AI & LLM systems