Alibaba's latest CosyVoice speech synthesis model and SenseVoice speech recognition model together form the FunAudioLLM framework, aimed at enhancing human-computer interaction experience. CosyVoice, with its realistic voice generation capability, can mimic voices of different genders, ages, and personalities, adding emotions and styles while even simulating natural features such as laughter, coughing, and breathing. SenseVoice focuses on high-precision multilingual speech recognition, emotion detection, and audio event detection, supporting over 50 languages.

The AliTongyi Lab recently opened sourced a large-scale audio generation model project called FunAudioLLM, aiming to enhance the natural voice interaction experience between humans and Large Language Models (LLMs). The project consists of two core models: SenseVoice and CosyVoice. CosyVoice focuses on natural voice generation, featuring multi-language support, voice and emotion control functions, and excels in multi-language voice generation, zero-shot voice generation, cross-language voice synt