ASR-Quantization

Free MLOps course from DataTalks.Club

Simple and Distributed Machine Learning

RAG (Retrieval Augmented Generation) Framework for building modular, open source applications for production by TrueFoundry

FEDML - The unified and scalable ML library for large-scale distributed training, model serving, and federated learning. FEDML Launch, a cross-cloud scheduler, further enables running any AI jobs on any GPU cloud or on-premise cluster. Built on this library, TensorOpera AI (https://TensorOpera.ai) is your generative AI platform at scale.

Boosting your Web Services of Deep Learning Applications.

Model Deployment at Scale on Kubernetes ??

nndeploy is an end-to-end model inference and deployment framework. It aims to provide users with a powerful, easy-to-use, high-performance, and mainstream framework compatible model inference and deployment experience.一款端到端的模型推理和部署框架。它旨在为用户提供功能强大、简单易用、高性能且兼容主流框架的模型推理和部署体验。

[ICML 2024] SqueezeLLM: Dense-and-Sparse Quantization

Serverless Machine Learning Course for building AI-enabled Prediction Services from models and features

[ICCV 2023] Q-Diffusion: Quantizing Diffusion Models.