Research from Renmin University: Caution Advised in Data Augmentation for Contrastive Learning
新智元
42
The latest research from Renmin University warns that caution is needed in data augmentation for contrastive learning. Strongly aligned positive samples may harm the generalization ability of contrastive learning. While stronger data augmentation can enhance downstream task performance, alignment performance decreases. The study reveals the mechanisms by which data augmentation affects contrastive learning and proposes seeking better data augmentation strategies from an information-theoretic and spectral perspective.
© Copyright AIbase Base 2024, Click to View Source - https://www.aibase.com/news/3251