CroSSL

Reading list for research topics in multimodal machine learning

An open-source framework for training large multimodal models.

Prompt Learning for Vision-Language Models (IJCV'22, CVPR'22)

[CVPR'24] UniRepLKNet: A Universal Perception Large-Kernel ConvNet for Audio, Video, Point Cloud, Time-Series and Image Recognition

A Comparative Framework for Multimodal Recommender Systems

An official implementation for "CLIP4Clip: An Empirical Study of CLIP for End to End Video Clip Retrieval"

A collection of resources on applications of multi-modal learning in medical imaging.

Biosignal Processing in Python

Multimodal model for text and tabular data with HuggingFace transformers as building block for text data

[NeurIPS 2021] Multiscale Benchmarks for Multimodal Representation Learning