Popular GitHub Repositories for Mpi

Distributed training framework for TensorFlow, Keras, PyTorch, and Apache MXNet.

This repository consists for gpu bootcamp material for HPC and AI

DeepHyper: Scalable Asynchronous Neural Architecture and Hyperparameter Search for Deep Neural Networks

Distributed and decentralized training framework for PyTorch over graph

FedTorch is a generic repository for benchmarking different federated and distributed learning algorithms using PyTorch Distributed API.

The Arbor multi-compartment neural network simulation library.

The Lightning plugin ecosystem provides fast quantum state-vector and tensor network simulators written in C++ for use with PennyLane.

Intel(R) Machine Learning Scaling Library is a library providing an efficient implementation of communication patterns used in deep learning.

Machine learning operator & controller for Kubernetes

Public Code Repository of the iRotate Active SLAM for Omnidirectional robots at the Max Planck Institute for Intelligent Systems, Tübingen

Framework of vectorized and distributed data analytics

MPI Parallel framework for training deep learning models built in Theano

Distributed training of DNNs ? C++/MPI Proxies (GPT-2, GPT-3, CosmoFlow, DLRM)

An implementation of HPL-AI Mixed-Precision Benchmark based on hpl-2.3

High performance implementation of Deep neuroevolution in pytorch using mpi4py. Intended for use on HPC clusters

?? RockyML - A High-Performance Scientific Computing Framework for Non-smooth Machine Learning Problems

Gradient-based Covariance Matrix Adaptation Evolutionary Strategy for Real Blackbox Optimization

Template for Deploying Distributed TensorFlow on Clusters Using MPI

"Hybrid quantum programming with PennyLane Lightning on HPC platforms" accompanying data and workloads

An HDF5-based library for parallel I/O operations on data structures for large-scale neural networks