Popular GitHub Repositories for Visual Question Answering

Implementation of ? Flamingo, state-of-the-art few-shot visual question answering attention net out of Deepmind, in Pytorch

A collection of resources on applications of multi-modal learning in medical imaging.

PyTorch implementation of "Transparency by Design: Closing the Gap Between Performance and Interpretability in Visual Reasoning"

[AAAI 2024] NuScenes-QA: A Multi-modal Visual Question Answering Benchmark for Autonomous Driving Scenario.

[NeurIPS 2024] This repo contains evaluation code for the paper "Are We on the Right Way for Evaluating Large Vision-Language Models"

TIFA: Accurate and Interpretable Text-to-Image Faithfulness Evaluation with Question Answering

[NeurIPS 2022] Zero-Shot Video Question Answering via Frozen Bidirectional Language Models

Large Language Models are Temporal and Causal Reasoners for Video Question Answering (EMNLP 2023)

[Paper][ISWC 2021] Zero-shot Visual Question Answering using Knowledge Graph

LLaVA inference with multiple images at once for cross-image analysis.

Multimodal Instruction Tuning for Llama 3

A Pytorch implementation of Attention on Attention module (both self and guided variants), for Visual Question Answering

Co-attending Regions and Detections for VQA.

:eyes: :speaking_head: :memo:12-in-1: Multi-Task Vision and Language Representation Learning Web Demo

Visual Instruction-guided Explainable Metric. Code for "Towards Explainable Metrics for Conditional Image Synthesis Evaluation" (ACL 2024)

Code to reproduce results in our ACL 2018 paper "Did the Model Understand the Question?"

ROCK model for Knowledge-Based VQA in Videos

? [ICLR 2025] Official Benchmark Toolkits for "Visual Haystacks: A Vision-Centric Needle-In-A-Haystack Benchmark"

[Paper][IJCKG 2022] LaKo: Knowledge-driven Visual Question Answering via Late Knowledge-to-Text Injection

Open-Vocabulary Video Question Answering: A New Benchmark for Evaluating the Generalizability of Video Question Answering Models (ICCV 2023)