AudioLDM2

:robot: The free, Open Source alternative to OpenAI, Claude and others. Self-hosted and local-first. Drop-in replacement for OpenAI, running on consumer-grade hardware. No GPU required. Runs gguf, transformers, diffusers and many more models architectures. Features: Generate Text, Audio, Video, Images, Voice Cloning, Distributed, P2P inference

AudioLDM: Generate speech, sound effects, music and beyond, with text.

TTS Generation Web UI (Bark, MusicGen + AudioGen, Tortoise, RVC, Vocos, Demucs, SeamlessM4T, MAGNet, StyleTTS2, MMS, Stable Audio, Mars5, F5-TTS, ParlerTTS)

Audio generation using diffusion models, in PyTorch.

A timeline of the latest AI models for audio generation, starting in 2023!

A family of diffusion models for text-to-audio generation.

InspireMusic: A Unified Framework for Music, Song, Audio Generation.

Official PyTorch implementation of BigVGAN (ICLR 2023)

AI Audio Datasets (AI-ADS) ?, including Speech, Music, and Sound Effects, which can provide training data for Generative AI, AIGC, AI model training, intelligent audio tool development, and audio applications.

[CVPR'23] MM-Diffusion: Learning Multi-Modal Diffusion Models for Joint Audio and Video Generation