Aurora

An open source implementation of CLIP.

A Unified Library for Parameter-Efficient and Modular Transfer Learning

Macaw-LLM: Multi-Modal Language Modeling with Image, Video, Audio, and Text Integration

The implementation of "Prismer: A Vision-Language Model with Multi-Task Experts".

A curated list of prompt-based paper in computer vision and vision-language learning.

A concise but complete implementation of CLIP with various experimental improvements from recent papers

A curated list of Visual Question Answering(VQA)(Image/Video Question Answering),Visual Question Generation ,Visual Dialog ,Visual Commonsense Reasoning and related area.

[CVPR 2024 & NeurIPS 2024] EmbodiedScan: A Holistic Multi-Modal 3D Perception Suite Towards Embodied AI

Build high-performance AI models with modular building blocks

[CVPR 2024] Official PyTorch Code for "PromptKD: Unsupervised Prompt Distillation for Vision-Language Models"