Popular GitHub Repositories for Multimodal Fusion

Semantic Segmentation for Remote Sensing

SuperYOLO is accepted by TGRS

Code on selecting an action based on multimodal inputs. Here in this case inputs are voice and text.

Multimodal sentiment analysis using hierarchical fusion with context modeling

Official implementation of "Multi-scale Bottleneck Transformer for Weakly Supervised Multimodal Violence Detection"

Source code for the paper "Automatic Fused Multimodal Deep Learning for Plant Identification" (Alfreds Lapkovskis, Natalia Nefedova & Ali Beikmohammadi, 2024)

[FR|EN - Trio] 2023 - 2024 Centrale Méditerranée AI Master | Multimodal retranscription with text, audio and video

Source code of a sample iOS app for the paper "Automatic Fused Multimodal Deep Learning for Plant Identification" (Alfreds Lapkovskis, Natalia Nefedova & Ali Beikmohammadi, 2024)