Popular GitHub Repositories for Multimodal Fusion

Semantic Segmentation for Remote Sensing

SuperYOLO is accepted by TGRS

端到端多功能故障检测

Code on selecting an action based on multimodal inputs. Here in this case inputs are voice and text.

Multimodal sentiment analysis using hierarchical fusion with context modeling

Official implementation of "Multi-scale Bottleneck Transformer for Weakly Supervised Multimodal Violence Detection"

[FR|EN - Trio] 2023 - 2024 Centrale Méditerranée AI Master | Multimodal retranscription with text, audio and video

Source code for the paper "Automatic Fused Multimodal Deep Learning for Plant Identification" (Alfreds Lapkovskis, Natalia Nefedova & Ali Beikmohammadi, 2024)

Source code of a sample iOS app for the paper "Automatic Fused Multimodal Deep Learning for Plant Identification" (Alfreds Lapkovskis, Natalia Nefedova & Ali Beikmohammadi, 2024)