NetEase Youdao Launches Open Source Speech Synthesis Engine 'Yimosheng' Supporting Over 2000 Voice Tones

站长之家

Published inAI News · 2 min read · Nov 10, 2023

413

NetEase Youdao Announces the Launch of the Open-Source "EmoVoice" Speech Synthesis Engine, Supporting Both Chinese and English, Featuring Over 2000 Different Voice Tones, and Including a Unique Emotional Synthesis Function. Users Can Download and Use It via GitHub, and Implement Emotional Synthesis and Application of Voice Tones Through the Provided Interface and Script Interfaces. The Project Aims to Help Developers and Content Creators Expand the Application Scope of High-Quality TTS. Additionally, NetEase Youdao Has Introduced Cool AI Technologies Such as Custom Voice Creation, Voice Duplication, and the Hi Echo Virtual Human Oral English Tutor, Offering Users More Personalized and Practical Services.

Sesame Releases CSM Voice Model: Transcending the Uncanny Valley with Globally Stunning Realism

Sesame's newly released Conversational Speech Model (CSM) has recently sparked heated discussions on X, lauded as a voice model that sounds "just like a real person." Its stunning naturalness and emotional expressiveness not only make it indistinguishable from human speech for users, but also claim to have successfully overcome the uncanny valley effect in the field of voice technology. With the spread of demonstration videos and user feedback, CSM is rapidly becoming a leader in AI voice technology.

Meta's Latest Audio Model SPIRIT LM: Making AI Not Just Talk, But Also Express Emotion!

Recently, Meta AI open-sourced a foundational multimodal language model named SPIRIT LM, which can freely mix text and speech, opening new possibilities for multimodal tasks involving audio and text. SPIRIT LM is based on a pre-trained text language model with 7 billion parameters, which has been continuously trained on text and speech units, expanding into the speech modality. It can understand and generate text like a large text model, while also being capable of understanding and generating speech, and even mixing text and speech to create various forms of expression.

OuteTTS-0.1-350M: A Novel Text-to-Speech Synthesis Method with Zero-Shot Voice Cloning Capability

Recently, Oute AI released a novel text-to-speech synthesis method called OuteTTS-0.1-350M. This method utilizes pure language modeling without the need for external adapters or complex architectures, offering a simplified TTS approach. OuteTTS-0.1-350M is based on the LLaMa architecture, using WavTokenizer to directly generate audio tokens, making the process more efficient. The model features zero-shot voice cloning capability, requiring only a few seconds of reference audio.

AI News

NetEase Youdao Launches Open Source Speech Synthesis Engine 'Yimosheng' Supporting Over 2000 Voice Tones

站长之家

AI News Recommendations

Spark-TTS: A Text-to-Speech System Supporting Zero-Shot Voice Cloning and Fine-grained Control

Sesame Releases CSM Voice Model: Transcending the Uncanny Valley with Globally Stunning Realism

Meta's Latest Audio Model SPIRIT LM: Making AI Not Just Talk, But Also Express Emotion!

OuteTTS-0.1-350M: A Novel Text-to-Speech Synthesis Method with Zero-Shot Voice Cloning Capability