contrastors

A PyTorch-based contrastive learning toolkit.

CommonProductProgrammingPyTorchContrastive Learning
contrastors is a contrastive learning toolkit that enables researchers and engineers to efficiently train and evaluate contrastive models. Built upon Flash Attention, it supports multi-GPU training, GradCache support for large batch training in memory-constrained environments. It also supports Huggingface, allowing for seamless loading of common models. Additionally, it supports masked language modeling pretraining and Matryoshka representation learning.
Visit

contrastors Visit Over Time

Monthly Visits

515580771

Bounce Rate

37.20%

Page per Visit

5.8

Visit Duration

00:06:42

contrastors Visit Trend

contrastors Visit Geography

contrastors Traffic Sources

contrastors Alternatives