At the opening ceremony of the 2024 Yunqi Conference, Giant Network made its debut and showcased its latest achievements in the "Game + AI" field. The company launched two self-developed large model applications—GiantGPT and BaiLing-TTS—while also demonstrating new technologies such as AI Digital Humans and the AI painting platform Giant Mimicry.

Soul App has made significant breakthroughs in the AI+Social field by upgrading its self-developed end-to-end full-duplex voice call model, achieving a natural and smooth voice communication experience with virtual characters that nearly matches the realism of talking to a real person. This model features ultra-low interaction latency, rapid automatic interruption, hyper-realistic voice expression, and emotional perception understanding capabilities, making it nearly impossible for users to distinguish whether their conversation partner is a real person or AI. This innovation not only significantly enhances the social experience for users on Soul but also showcases Soul's advancements in AI technology.

At the Volcano Engine AI Innovation Roadshow in Shanghai on August 21, 2024, Volcano Engine showcased a comprehensive upgrade of the Doubao Large Model. This includes the Doubao Text-to-Image Model, which has improved text and image matching capabilities for long texts, the Doubao Speech Recognition Model, which reduced error rates by up to 40% across multiple public test sets, and upgrades to the Doubao Speech Synthesis Model, enhancing streaming speech synthesis abilities for real-time responses and accurate punctuation. Volcano Engine also released a real-time interactive solution for Conversational AI, integrating the Doubao Large Model with real-time audio and video technology, providing end-to-end capabilities.

Alibaba recently launched the new open-source voice model Qwen2-Audio, which excels in speech recognition, translation, and audio analysis, achieving significant performance improvements. Qwen2-Audio offers a basic version and an instruction fine-tuning version, supporting multiple languages such as Chinese, Cantonese, French, English, and Japanese, facilitating sentiment analysis and translation applications. Compared to Qwen-Audio, Qwen2-Audio features comprehensive optimizations in architecture and performance, utilizing more natural language prompts during the pre-training phase.

Xiaomi's SU7 car has undergone a system upgrade to HyperOS 1.2.7, introducing key features like external wake-up defense and front vehicle recognition. This system update brings the highly anticipated 'external wake-up defense' functionality. When the vehicle is in P gear, the central control is locked, and all doors and windows are closed, this feature will automatically activate, effectively blocking voice wake-up attempts from outside, significantly enhancing the vehicle's security. This improvement directly addresses user feedback regarding the safety risks associated with external voice wake-ups.

Fudan University has introduced SpeechGPT, a large language model designed to understand and generate both speech and text. By discretizing speech signals, it enables compatibility with text modalities, allowing for emotional perception and multi-style speech generation based on context and instructions. The training strategy includes modal adaptation pre-training, cross-modal instruction fine-tuning, and modal chain instruction fine-tuning to en....