Popular GitHub Repositories for Video To Audio

[CVPR 2025] Taming Multimodal Joint Training for High-Quality Video-to-Audio Synthesis

Text and image to video generation: Kandinsky 4.0 (2024)

Official implementation of the pipeline presented in I hear your true colors: Image Guided Audio Generation

Generate subtitles for all the videos in a folder with OpenAI's Whisper privately in your computer.

[AAAI 2024] V2A-Mapper: A Lightweight Solution for Vision-to-Audio Generation by Connecting Foundation Models

The code and weight for LoVA. LoVA is a novel model for Long-form Video-to-Audio generation. Based on the Diffusion Transformer (DiT) architecture, LoVA proves to be more effective at generating long-form audio compared to existing autoregressive models and UNet-based diffusion models.

Luma AI 和 RunwayML 的 AI 视频、音频和图像生成功能，包括RunwayML基于图像和文本的视频生成。

WebUI for MMAudio Video-to-Audio and Text-to-Audio.

WebUI for MMAudio.

WhisperUI_4Mac_MPS is a macOS application leveraging Apple Silicon for efficient video-to-audio conversion and multilingual transcription using OpenAI's Whisper Large v3 Turbo. It features CUDA support, YouTube integration, batch processing, and real-time resource monitoring. Optimize your audio workflow with this powerful tool.