Popular GitHub Repositories for Grounding

[ECCV2024] Grounded Multimodal Large Language Model with Localized Visual Tokenization

CALVIN - A benchmark for Language-Conditioned Policy Learning for Long-Horizon Robot Manipulation Tasks

CLIPort: What and Where Pathways for Robotic Manipulation

We perform functional grounding of LLMs' knowledge in BabyAI-Text

Hierarchical Universal Language Conditioned Policies

Official implementation of ICCV19 oral paper Zero-Shot grounding of Objects from Natural Language Queries (https://arxiv.org/abs/1908.07129)

[CVPR20] Video Object Grounding using Semantic Roles in Language Description (https://arxiv.org/abs/2003.10606)

[CVPR21] Visual Semantic Role Labeling for Video Understanding (https://arxiv.org/abs/2104.00990)

[Paper][AAAI 2023] DUET: Cross-modal Semantic Grounding for Contrastive Zero-shot Learning

[ICRA2023] Grounding Language with Visual Affordances over Unstructured Data

A simple demo for utilizing grounding dino and segment anything v2 models together

Unified layout planning and image generation

A lightweight SDK enabling integration of Gemini for .NET in a simple way

A Rust client for Google Gemini API, that supports tools, and grounding