awesome-vision-and-language-pretraining

An open source implementation of CLIP.

The official GitHub page for the survey paper "A Survey of Large Language Models".

Open Source Pre-training Model Framework in PyTorch & Pre-trained Model Zoo

Papers about pretraining and self-supervised learning on Graph Neural Networks (GNN).

Macaw-LLM: Multi-Modal Language Modeling with Image, Video, Audio, and Text Integration

Code for TKDE paper "Self-supervised learning on graphs: Contrastive, generative, or predictive"

The implementation of "Prismer: A Vision-Language Model with Multi-Task Experts".

Research code for ECCV 2020 paper "UNITER: UNiversal Image-TExt Representation Learning"

Code for ICLR 2020 paper "VL-BERT: Pre-training of Generic Visual-Linguistic Representations".

A concise but complete implementation of CLIP with various experimental improvements from recent papers