Popular GitHub Repositories for Lmm

[CVPR 2024 ?] Grounding Large Multimodal Model (GLaMM), the first-of-its-kind model capable of generating natural language responses that are seamlessly integrated with object segmentation masks.

[CVPR'24] HallusionBench: You See What You Think? Or You Think What You See? An Image-Context Reasoning Benchmark Challenging for GPT-4V(ision), LLaVA-1.5, and Other Multi-modality Models

Official code for Paper "Mantis: Multi-Image Instruction Tuning" [TMLR2024]

A RLHF Infrastructure for Vision-Language Models

? curated list of awesome LMM hallucinations papers, methods & resources.

??? Yo'LLaVA: Your Personalized Language and Vision Assistant

[CVPR 2025 ?]A Large Multimodal Model for Pixel-Level Visual Grounding in Videos

LLaVA inference with multiple images at once for cross-image analysis.

[COLING 2025] Idea23D: Collaborative LMM Agents Enable 3D Model Generation from Interleaved Multimodal Inputs

Use Gemini to auto-label images for use with Autodistill.

Novel approach that leverages LVLMs to efficiently generate high-quality synthetic VQA-NLE datasets.

Foundation Models and Biometrics: A Survey and Outlook