The Alibaba Cloud Bairen Model Service Platform recently launched the 'Real-Time Audio and Video Interaction' feature, enabling users to easily build multi-modal AI applications without the need for programming knowledge. This new feature allows users to quickly integrate AI models into Web, iOS, and Android applications and share them with others. Users can create intelligent agent applications through simple steps: first, create a new intelligent agent application, then select and configure the required text, speech, or visual understanding models on the Alibaba Cloud Bairen platform. The platform offers over 200 large models, including

Recently, New York-based company Runway announced the launch of a new talent network aimed at helping brands, agencies, and film production companies hire AI film creators. With advancements in video generation by Google and OpenAI, Runway hopes to expand the application of its AI video tools through this platform. The new Runway talent network provides a platform for creators, artists, and companies focused on AI video tools from around the world to showcase their work.

Nexa AI recently unveiled its new OmniAudio-2.6B audio language model, designed to meet the efficient deployment demands of edge devices. Unlike traditional architectures that separate automatic speech recognition (ASR) and language models, OmniAudio-2.6B integrates Gemma-2-2b, Whisper Turbo, and a custom projector into a unified framework. This design eliminates the inefficiencies and delays associated with linking various components in traditional systems, making it especially suitable for resource-constrained computing.

Recently, Jiyue Xingchen announced the launch of a new member in the Step series model matrix—the Step-1o end-to-end speech model, claimed to be the first trillion-parameter end-to-end speech model in China. The release of this new model marks a significant advancement in the field of speech technology. By utilizing an end-to-end speech solution, it integrates speech understanding and generation, thereby enhancing the IQ and EQ limits of the model and providing a supernatural, high-quality communication experience.

Recently, a research team from the University of Illinois at Urbana-Champaign, Sony AI, and Sony Group introduced a new technology called MMAudio, which aims to achieve high-quality audio synthesis from videos through multi-modal joint training. The core innovation of MMAudio is its ability to generate synchronized audio using video and text inputs, thereby expanding the application scenarios for audio generation. MMAudio is designed to support generating sound effects that align with video content from either video or text inputs.

Alibaba's Damo Academy Tongyi Lab recently announced the open sourcing of a voice processing technology called ClearerVoice-Studio, aimed at enhancing voice quality and intelligibility. As voice technology becomes more widely used, voice quality is gaining increasing attention, especially in situations involving background noise, reverberation, and device pickup, leading to a growing demand for voice processing technology.

Recently, Adobe's research team collaborated with researchers from the University of Michigan to develop an artificial intelligence system called MultiFoley, which generates sound effects for dubbing in films and videos, assisting in post-production. The innovation of MultiFoley lies in its ability to allow users to create sound effects through text prompts, reference audio, or video examples. In demonstrations, the system can even transform a cat's meow into a lion's roar, or convert the sound of a typewriter into piano notes, perfectly synchronized with video footage.

Elon Musk, the world's richest man and a seasoned gaming enthusiast, recently expressed his dissatisfaction with the current state of the gaming industry on social media. He announced that his company, xAI, will establish a new AI game studio aimed at revitalizing the gaming sector. Musk criticized how many game studios have been acquired by large corporations, resulting in game content being influenced by commercial and political factors. He urged developers to focus on the quality and enjoyment of games themselves, bypassing woke agendas.

Remember the scenes in sci-fi movies where the protagonist wields a magic wand to effortlessly manipulate sound? Now, this magical ability is no longer a fantasy! NVIDIA's latest AI model, Fugatto, acts like a 'sound magic wand,' allowing users to control music, sounds, and voices with just text, creating various wonderful auditory effects. Fugatto, short for 'Foundational Generative Audio Transformer Opus1,' is a...

In the fields of music and sound creation, the combination of technology and creativity often faces numerous challenges. Existing AI models typically excel at specific tasks but lack broad adaptability, limiting AI's auxiliary role in music production. To better serve music and audio production, there is an urgent need for a versatile model that can flexibly respond to various creative needs. Therefore, NVIDIA has launched Fugatto, an audio generation and processing model with 2.5 billion parameters. Fugatto is designed to...

Recently, Meta AI open-sourced a foundational multimodal language model named SPIRIT LM, which can freely mix text and speech, opening new possibilities for multimodal tasks involving audio and text. SPIRIT LM is based on a pre-trained text language model with 7 billion parameters, which has been continuously trained on text and speech units, expanding into the speech modality. It can understand and generate text like a large text model, while also being capable of understanding and generating speech, and even mixing text and speech to create various forms of expression.

Microsoft has recently made significant progress in the field of enterprise AI intelligences, establishing the world's largest enterprise AI intelligent ecosystem. Since the launch of Copilot Studio, over 100,000 organizations have participated in the creation and editing of AI intelligences. This milestone signifies Microsoft's leading position in the enterprise technology sector. Microsoft executive Charles Lamanna stated that the growth rate exceeded expectations, being faster than the adoption rate of any cutting-edge technology previously released by the company.