mlinfra

A high-throughput and memory-efficient inference and serving engine for LLMs

Learn how to design, develop, deploy and iterate on production-grade ML applications.

Workflow Engine for Kubernetes

Machine Learning Engineering Open Book

A curated list of references for MLOps

An orchestration platform for the development, production, and observation of data assets.

Free MLOps course from DataTalks.Club

Run any open-source LLMs, such as DeepSeek and Llama, as OpenAI compatible API endpoint in the cloud.

Example ? Jupyter notebooks that demonstrate how to build, train, and deploy machine learning models using ? Amazon SageMaker.

Kedro is a toolbox for production-ready data science. It uses software engineering best practices to help you create data engineering and data science pipelines that are reproducible, maintainable, and modular.