Popular GitHub Repositories for Distributed Data Parallel

Distributed training (multi-node) of a Transformer model

Code for Active Learning at The ImageNet Scale. This repository implements many popular active learning algorithms and allows training with torch's DDP.

Unofficial implementation for Sigmoid Loss for Language Image Pre-Training

Different template codes for Deep Learning with PyTorch.