Popular GitHub Repositories for Cross Modal Retrieval

? Scalable embedding, reasoning, ranking for images and sentences with CLIP

Offline semantic Text-to-Image and Image-to-Image search on Android powered by quantized state-of-the-art vision-language pretrained CLIP model and ONNX Runtime inference engine

Unsupervised Contrastive Cross-modal Hashing (IEEE TPAMI 2023, PyTorch Code)

[CVPR 2024] Do you remember? Dense Video Captioning with Cross-Modal Memory Retrieval

PyTorch implementation of the AAAI-21 paper "Dual Adversarial Label-aware Graph Neural Networks for Cross-modal Retrieval" and the TPAMI-22 paper "Integrating Multi-Label Contrastive Learning with Dual Adversarial Graph Neural Networks for Cross-Modal Retrieval".

An AI-powered interactive video retrieval system

[ACM MM 2024] Improving Composed Image Retrieval via Contrastive Learning with Scaling Positives and Negatives

Dataset and code for EMNLP 2022 "Visual Named Entity Linking: A New Dataset and A Baseline"

[ICLR 2025] Official code repository for "TULIP: Token-length Upgraded CLIP"

[TIP2024] The code of "GSSF: Generalized Structural Sparse Function for Deep Cross-modal Metric Learning"

PyTorch code for the paper "Complementarity is the king: A multi-modal and multi-grained hierarchical semantic enhancement network for cross-modal retrieval"

My master thesis: Siamese multi-hop attention for cross-modal retrieval.