In today's wave of technology, conversational artificial intelligence (AI) has become an important part of our lives. However, fast, efficient, and real-time interactions remain a significant challenge. The issue of latency, which refers to the time difference between input and response, often slows down the experience of customer service robots and virtual assistants, affecting user satisfaction. To address this gap, Standard Intelligence Lab has recently launched Hertz-Dev, an open-source audio model with 850 million parameters.

Google AI Studio and Gemini API have recently launched the 'Real-Time Connection with Google Search' feature, aimed at helping developers improve the accuracy of AI model responses by integrating real-time data from Google Search. With this update, the Gemini 1.5 model can retrieve the latest information from Google Search, enhancing the accuracy and transparency of responses. Developers can directly access this feature in the 'Tools' section of Google AI Studio or in the Gemini API.

Microsoft recently launched its latest product - an autonomous AI agent, also known as 'Virtual Employees', at an event in London. These AI workers can independently handle customer inquiries and identify sales leads, which means companies can operate more efficiently. Notably, Microsoft offers not only ten ready-made AI robots but also allows clients to customize AI agents based on their needs, bringing new opportunities to various industries. Image source note: The image is generated by AI, and image rights are provided by Midjourney.

Microsoft is conducting 'AI Tour' events in 60 cities worldwide. These one-day events aim to bridge the gap, allowing business professionals interested in AI to engage directly with Microsoft engineers and sales teams to discuss how to create 'AI-first' enterprises and the potential applications of its core technology, Copilot.

OpenAI once again leads the trend in artificial intelligence technology with the launch of the brand new gpt-4o-audio-preview model. This model not only showcases impressive capabilities in speech generation and analysis but also opens up new possibilities for human-computer interaction. Let's delve into the features of this innovative model and its potential applications. The core functionalities of gpt-4o-audio-preview include three main aspects: first, it can generate natural and fluent voice responses based on text, serving applications such as voice assistants and virtual customer service.

Google announced on Thursday a significant upgrade to its AI note-taking and research assistant NotebookLM, bringing users a smarter and more personalized experience. This update focuses mainly on the highly anticipated audio overview feature, allowing users to guide the AI-generated conversation content more precisely, concentrating on specific topics rather than just generating comprehensive audio summaries. Since its launch last month, the audio overview feature of NotebookLM has rapidly gained popularity due to its podcast-like AI-generated conversation format, with many users beginning to share their experiences on social media.

When creating engaging videos, audio plays a crucial role alongside visuals. However, finding or producing the right sound effects can often be a time-consuming task. At Adobe's annual MAX conference, they showcased an experimental prototype called Project Super Sonic, a technology that can generate sound effects from text, recognize objects in videos, and even utilize your voice to quickly produce background sounds and effects for video projects. While the feature of generating sound effects from text prompts sounds promising,

At the global creative conference Adobe MAX 2024, Adobe launched its latest product - GenStudio, a brand new solution specifically designed for performance marketing. GenStudio is part of the Adobe GenStudio ecosystem and aims to help businesses achieve greater efficiency and personalized experiences in content creation and marketing processes. It optimizes every marketing stage comprehensively from content planning and creation to management, activation, and performance measurement.

Shenzhen Riecho Technology Co., Ltd. recently issued a statement confirming that the audio portion of the audiovisual materials circulated on September 16 was cloned by the suspect using its self-developed Reecho AI voice generation model platform. The audio is derived from a live broadcast segment by Lu. The company has initiated an internal review mechanism to strengthen user identity authentication and audio generation security management to ensure the lawful and compliant use of the technology. Reecho stated that as a startup team established less than a year ago, we are committed to frontier technologies in audio and anthropomorphic artificial intelligence.

In today's rapidly advancing world of artificial intelligence, voice synthesis and transformation technologies are evolving at an extraordinary pace, providing us with incredibly realistic and natural audio experiences. However, these technological advancements also bring potential security risks, particularly as 'voice cloning' technology could be exploited by malicious individuals, threatening personal privacy and social stability. In response to this challenge, the Intelligent System Security Laboratory of Zhejiang University and Tsinghua University have joined forces to launch a revolutionary audio forgery detection framework - SafeEar. This framework not only efficiently detects forged audio but also ensures privacy protection during the detection process.

In the context of rapid advancements in voice synthesis technology, voice forgery has become increasingly severe, posing significant threats to user privacy and social security. Recently, the Intelligent System Security Laboratory at Zhejiang University and Tsinghua University jointly released a novel voice forgery detection framework called 'SafeEar.' This framework aims to efficiently detect forgeries while protecting the privacy of voice content. The concept behind SafeEar is to cleverly design a decoupled model based on neural audio codecs that effectively separates the acoustic features of voice.

In today's rapidly advancing technology, speech synthesis technology is also progressing, especially in the field of restoring lost voices. Recently, Google researchers introduced a new technology called 'Zero-shot Voice Transfer' which can be directly integrated with state-of-the-art Text-to-Speech (TTS) systems to help those who have lost their voices due to illness or accidents regain their 'voice memory'. The core of this technology is its 'zero-shot' capability, meaning that we do not need a large number of samples to achieve this.

In an age of information overload, efficiently acquiring knowledge has become a challenge for many learners and professionals. Recently, an open-source tool named PDF2Audio has emerged, cleverly combining artificial intelligence technology with traditional reading methods to provide users with a new way of obtaining information. The core function of PDF2Audio is to convert PDF documents into audio content. This tool utilizes OpenAI's GPT model for text generation and speech synthesis, allowing various PDF files to be transformed into podcasts, lectures, or excerpts.

Recently, Johns Hopkins University and Tencent AI Lab jointly launched a new text-to-audio generation model named EzAudio. This technology promises unprecedented efficiency and high-quality text-to-speech conversion, marking a significant leap in artificial intelligence and audio technology. EzAudio operates by utilizing the latent space of audio waveforms instead of traditional spectrograms, an innovation that allows it to work at high temporal resolution without the need for an additional neural vocoder. The architecture of EzAudio is referred to as EzAu.

At the intersection of technology and creativity, Snap, the parent company of Snapchat, has once again showcased its innovative prowess. During the Snap Partner Summit held recently in Santa Monica, California, the company announced a series of exciting AI tool upgrades aimed at providing creators with a more powerful and intuitive content creation experience. The most notable new feature is 'Easy Lens.' This innovative tool allows creators to easily generate Snap's unique augmented reality (AR) objects, 3D effects, and characters through simple English descriptions.

Google has recently launched an exciting experimental feature—AI-generated podcasts. This feature can transform your research materials into engaging podcast segments, featuring two 'hosts' discussing the information you have gathered.

Amazon's Audible has announced an innovative plan to use artificial intelligence (AI) technology to train the voices of professional narrators in order to produce high-quality audiobooks. Starting this week, selected audiobook narrators from the U.S. will participate in the AI training process, ensuring that the AI-generated voices can compete with those of professionals. Narrators will have the opportunity to review the AI-generated voices to ensure they align with the style and tone of the work, and to fine-tune the AI's pronunciation and pacing. Audible has committed to compensating participating narrators based on book titles and royalty sharing.