Multimodal-Document-Analysis-and-Query-Retrieval

[EMNLP 2023 Demo] Video-LLaMA: An Instruction-tuned Audio-Visual Language Model for Video Understanding

Metadata-indexer and Viewer for AI-generated images

[ICRA 2024] Chat with NeRF enables users to interact with a NeRF model by typing in natural language.

(AAAI 2024) BLIVA: A Simple Multimodal LLM for Better Handling of Text-rich Visual Questions

Automate Fashion Image Captioning using BLIP-2. Automatic generating descriptions of clothes on shopping websites, which can help customers without fashion knowledge to better understand the features (attributes, style, functionality etc.) of the items and increase online sales by enticing more customers.

Implementation of Qformer from BLIP2 in Zeta Lego blocks.

[ACM MM 2024] Improving Composed Image Retrieval via Contrastive Learning with Scaling Positives and Negatives

This repository is for profiling, extracting, visualizing and reusing generative AI weights to hopefully build more accurate AI models and audit/scan weights at rest to identify knowledge domains for risk(s).

Caption images across your datasets with state of the art models from Hugging Face and Replicate!

Annotations on a Budget: Leveraging Geo-Data Similarity to Balance Model Performance and Annotation Cost