ASR-Quantization

Free MLOps course from DataTalks.Club

Simple and Distributed Machine Learning

RAG (Retrieval Augmented Generation) Framework for building modular, open source applications for production by TrueFoundry

FEDML - The unified and scalable ML library for large-scale distributed training, model serving, and federated learning. FEDML Launch, a cross-cloud scheduler, further enables running any AI jobs on any GPU cloud or on-premise cluster. Built on this library, TensorOpera AI (https://TensorOpera.ai) is your generative AI platform at scale.

Boosting your Web Services of Deep Learning Applications.

Ebooks that will help to understand core concepts easily.

Model Deployment at Scale on Kubernetes ??

nndeploy is an end-to-end model inference and deployment framework. It aims to provide users with a powerful, easy-to-use, high-performance, and mainstream framework compatible model inference and deployment experience.一款端到端的模型推理和部署框架。它旨在为用户提供功能强大、简单易用、高性能且兼容主流框架的模型推理和部署体验。

[ICML 2024] SqueezeLLM: Dense-and-Sparse Quantization

Serverless Machine Learning Course for building AI-enabled Prediction Services from models and features