Recently, AI video creation platform D-ID has launched a new AI video translation tool called AI Video Translate. This tool can translate videos into multiple languages, and not only that, D-ID also clones the speaker's voice and adjusts the lip movements to ensure the translated content perfectly matches the video footage.
Product Entry:https://top.aibase.com/tool/d-id-ai-video-translate
The tool can achieve the following effects:
Voice Cloning: Automatically clones the speaker's voice for cross-language consistency.
Lip Movement Adaptation: Perfectly synchronizes the speaker's lip movements for a natural appearance.
Batch Rendering: Quickly translates your video into up to 29 languages.
User-Friendly Interface: Drag-and-drop functionality and intuitive design make it easy for anyone to use.
The technology behind this stems from D-ID's previous innovative work, such as a few years ago, when users could bring old photos to life, making them speak, which garnered widespread attention.
To support its growing enterprise customers, D-ID raised $25 million in a Series B funding round in 2022. Now, the newly launched AI video translation technology is currently available for free to D-ID's subscribers. Creators can use this technology to automatically translate their videos into 30 languages, including Arabic, Mandarin, Japanese, Hindi, Spanish, and French, which will help them expand their audience.
D-ID states that this new technology can help customers promote their marketing, entertainment, and social media activities globally, saving on localization costs. In the past, dubbing technology allowed video viewers to listen to audio in their familiar language, but for some small creators, this technology was often out of reach.
Technological advancements are changing the situation. For example, YouTube recently introduced a multilingual audio feature to help creators translate their videos into other languages. Notable YouTube creator MrBeast (Jimmy Donaldson) was one of the early adopters, using this technology to translate several popular videos into 11 languages.
Now, with the development of AI technology, the ability to create, translate, and clone voices is also improving. This year, Microsoft announced the use of AI for real-time translation and dubbing of YouTube videos, and Vimeo also introduced tools in July to support audio and subtitle translation, and the ability to clone the narrator's voice using AI technology. Additionally, many companies offer voice cloning or AI translation tools, including Descript, ElevenLabs, Speechify, and more.
D-ID's new video translation technology will be available through D-ID Studio and its API. The company also offers a one-month trial, and more demos can be found on their official website. According to requirements, video length should be between 10 seconds to 5 minutes, with a file size not exceeding 2GB, and it is best if the video only includes one speaker facing the camera with their face always visible for optimal results.
Key Points:
✨ D-ID introduces AI video translation tool, supporting automatic translation into 30 languages, with voice cloning and lip synchronization.
🌍 This tool will help enterprise customers reduce localization costs for global promotion and expand their audience.
🎥 Currently, the supported video duration is 10 seconds to 5 minutes, with a file size limit of 2GB.