Recently, the Modelers community officially launched Step-Video and Step-Audio, two open-source multimodal large models developed by Step-Star. These models are designed for video generation and voice interaction, respectively, aiming to provide developers and enterprise users with more powerful AI tools. Step-Video, formally known as Step-Video-T2V, is a 30-billion parameter model, making it the world's largest open-source video generation model. This model can directly generate 20...

Hedra has announced a significant advancement in AI digital humans with the launch of its Character-3 model and Hedra Studio. This new technology enables joint reasoning across images, text, and audio, leading to more realistic and interactive digital human experiences.

According to TechCrunch, voice AI company ElevenLabs now allows authors to publish AI-generated audiobooks on its reader app, following a previous partnership with Spotify for AI-narrated audiobooks. ElevenLabs, which raised a massive $190 million last month, began inviting authors to pilot the publishing program last year and has now opened it to all authors. The company aims to provide affordable and easy-to-use audiobook creation tools to reduce production costs and compete with Audible.

A recent experiment using artificial intelligence (AI) to create a novel dish has unexpectedly gone viral, sparking widespread online discussion. Popular blogger "Los Angeles Yingzheng W" shared a video on Douyin (TikTok) showcasing the process of using the DeepSeek model to generate and cook an "unprecedented AI dish." The video quickly climbed the Douyin trending charts, attracting significant attention and debate. Despite the blogger's best efforts to follow the AI model's somewhat "abstract" instructions, the final result appears to have fallen short of expectations.

On Thursday, Spotify announced its partnership with ElevenLabs to officially introduce audiobooks narrated using the company's AI voice technology. As one of the most recognized AI audio providers, this new collaboration is expected to significantly increase the number of AI-narrated audiobooks on the platform. According to the new process, authors need to first download audio file packages from ElevenLabs, then access Spotify's audiobook distribution service, Findaway Voices.

On January 20th, SenseTime announced that its 'SenseNova-5o Interactive Version' is officially providing real-time audio and video conversation services, available to users for free for a limited time. The release of this interactive version marks another significant advancement for SenseTime in the field of artificial intelligence, aiming to enable more natural and smoother communication between AI and humans through powerful real-time interaction, visual recognition, memory thinking, and complex reasoning capabilities.

Douyin Group recently released the 2024 Live Streaming Governance Report, showcasing the platform's governance philosophy, methods, and achievements in the live streaming field. Over the past year, Douyin has committed to building a safe, trustworthy, and clean online live streaming environment by improving anchor management mechanisms, enhancing content identification technology, coordinating online and offline governance, and protecting key groups, resulting in significant achievements.

The Alibaba Cloud Bairen Model Service Platform recently launched the 'Real-Time Audio and Video Interaction' feature, enabling users to easily build multi-modal AI applications without the need for programming knowledge. This new feature allows users to quickly integrate AI models into Web, iOS, and Android applications and share them with others. Users can create intelligent agent applications through simple steps: first, create a new intelligent agent application, then select and configure the required text, speech, or visual understanding models on the Alibaba Cloud Bairen platform. The platform offers over 200 large models, including

Nexa AI recently unveiled its new OmniAudio-2.6B audio language model, designed to meet the efficient deployment demands of edge devices. Unlike traditional architectures that separate automatic speech recognition (ASR) and language models, OmniAudio-2.6B integrates Gemma-2-2b, Whisper Turbo, and a custom projector into a unified framework. This design eliminates the inefficiencies and delays associated with linking various components in traditional systems, making it especially suitable for resource-constrained computing.

Recently, Jiyue Xingchen announced the launch of a new member in the Step series model matrix—the Step-1o end-to-end speech model, claimed to be the first trillion-parameter end-to-end speech model in China. The release of this new model marks a significant advancement in the field of speech technology. By utilizing an end-to-end speech solution, it integrates speech understanding and generation, thereby enhancing the IQ and EQ limits of the model and providing a supernatural, high-quality communication experience.