contrastors
A PyTorch-based contrastive learning toolkit.
CommonProductProgrammingPyTorchContrastive Learning
contrastors is a contrastive learning toolkit that enables researchers and engineers to efficiently train and evaluate contrastive models. Built upon Flash Attention, it supports multi-GPU training, GradCache support for large batch training in memory-constrained environments. It also supports Huggingface, allowing for seamless loading of common models. Additionally, it supports masked language modeling pretraining and Matryoshka representation learning.
contrastors Visit Over Time
Monthly Visits
488643166
Bounce Rate
37.28%
Page per Visit
5.7
Visit Duration
00:06:37