SPMNet

:robot: The free, Open Source alternative to OpenAI, Claude and others. Self-hosted and local-first. Drop-in replacement for OpenAI, running on consumer-grade hardware. No GPU required. Runs gguf, transformers, diffusers and many more models architectures. Features: Generate Text, Audio, Video, Images, Voice Cloning, Distributed, P2P inference

? Scalable embedding, reasoning, ranking for images and sentences with CLIP

a state-of-the-art-level open visual language model | 多模态预训练模型

AudioLDM: Generate speech, sound effects, music and beyond, with text.

Text-to-Audio/Music Generation

TTS Generation Web UI (Bark, MusicGen + AudioGen, Tortoise, RVC, Vocos, Demucs, SeamlessM4T, MAGNet, StyleTTS2, MMS, Stable Audio, Mars5, F5-TTS, ParlerTTS)

Audio generation using diffusion models, in PyTorch.

A timeline of the latest AI models for audio generation, starting in 2023!

A family of diffusion models for text-to-audio generation.

InspireMusic: A Unified Framework for Music, Song, Audio Generation.