SPN4CIR

[EMNLP 2023 Demo] Video-LLaMA: An Instruction-tuned Audio-Visual Language Model for Video Understanding

Famous Vision Language Models and Their Architectures

?? + ? + ? = ? Curated list of top foundation and multimodal models! [Paper + Code + Examples + Tutorials]

Chain together LLMs for reasoning & orchestrate multiple large models for accomplishing complex tasks

[ICRA 2024] Chat with NeRF enables users to interact with a NeRF model by typing in natural language.

(AAAI 2024) BLIVA: A Simple Multimodal LLM for Better Handling of Text-rich Visual Questions

This repository provides an interactive image colorization tool that leverages Stable Diffusion (SDXL) and BLIP for user-controlled color generation. With a retrained model using the ControlNet approach, users can upload images and specify colors for different objects, enhancing the colorization process through a user-friendly Gradio interface.

[ACM MM'24 Oral] RainMamba: Enhanced Locality Learning with State Space Models for Video Deraining

Automate Fashion Image Captioning using BLIP-2. Automatic generating descriptions of clothes on shopping websites, which can help customers without fashion knowledge to better understand the features (attributes, style, functionality etc.) of the items and increase online sales by enticing more customers.

Implementation of Qformer from BLIP2 in Zeta Lego blocks.