MOE-FL

DeepSpeed is a deep learning optimization library that makes distributed training and inference easy, efficient, and effective.

A curated list of references for MLOps

Perform data science on data that remains in someone else's server

FEDML - The unified and scalable ML library for large-scale distributed training, model serving, and federated learning. FEDML Launch, a cross-cloud scheduler, further enables running any AI jobs on any GPU cloud or on-premise cluster. Built on this library, TensorOpera AI (https://TensorOpera.ai) is your generative AI platform at scale.

Decentralized deep learning in PyTorch. Built to train models on thousands of volunteers across the world.

Mixture-of-Experts for Large Vision-Language Models

Everything about federated learning, including research papers, books, codes, tutorials, videos and beyond

Master Federated Learning in 2 Hours—Run It on Your PC!

An easy-to-use federated learning platform

Implementation of Communication-Efficient Learning of Deep Networks from Decentralized Data