On January 20, 2025, the Doubao App officially launched its latest "end-to-end" voice model and made significant updates to its real-time voice calling feature. This advancement marks another leap for Doubao in the field of voice interaction, surpassing the previous cascading solutions of ASR (Automatic Speech Recognition), LLM (Large Language Model), and TTS (Text-to-Speech) by integrating speech recognition, understanding, and generation into a single model.
According to tests conducted by "Intelligent Emergence," the standout feature of the new Doubao is its human-like expressive capability and emotional output, which enhances the fluency and intelligence of conversations. Particularly, the "Soul Singer" and "Versatile Star" modes allow Doubao not only to sing but also to engage in rich role-playing, making it a new favorite for user interaction. For example, when a user asks Doubao to mimic the voice of celebrity Yu Shuxin, Doubao not only successfully replicates the character's tone but also playfully expresses its unique personality.
What's even more impressive is that Doubao can spontaneously create songs in natural conversations without the need for complex commands or professional prompts. Users can request Doubao to sing at will, even specifying themes for the lyrics. Although Doubao may occasionally make minor mistakes, its speed of response and improvisational ability are astonishing, showcasing its strong anthropomorphic capabilities.
Additionally, the new "Grumpy Doubao" and "Compliment Master" personality modes bring freshness to users. These personality modes allow Doubao to display different emotions and styles in various contexts, enhancing the fun and authenticity of interactions.
In today's rapidly advancing voice interaction technology, this update from Doubao not only expands the application scenarios of AI to areas such as emotional companionship and psychological counseling but also brings AI's emotional communication abilities closer to those of humans. This transformation will undoubtedly secure Doubao a place in the fiercely competitive market and lead the future development of AI interaction.
