When watching dubbed movies, audiences often encounter a problem: the lip movements of the characters do not match the dubbed language. This not only affects the viewing experience but also makes it difficult to immerse oneself in the story. To change this situation, NeuralGarage, an Indian startup founded in 2021, is actively working to revolutionize the dubbing industry.
Image Source Note: Image generated by AI, licensed from Midjourney
NeuralGarage, headquartered in Bangalore, India, was co-founded by four old friends: Anjan Banerjee, Subhasis Saha, Subhabrata Debnath, and Mandar Natkar. The platform aims to address the issue of mismatched facial movements in dubbing content. With its technology "VisualDub," NeuralGarage not only ensures that the characters' lip movements are synchronized with the voiceover but also maintains the naturalness and high quality of the visuals.
NeuralGarage stood out in the AWS Global Generative AI Accelerator program, receiving support including $1 million in AWS promotional credits. The company emphasizes that ensuring video quality while adjusting facial expressions is crucial, especially when dealing with changes in camera angles and lighting conditions, making this challenge particularly daunting.
For instance, when watching "Money Heist," if the professor speaks in Spanish, NeuralGarage's technology can make it appear as though he is speaking in English. The company's co-founder and CTO, Subhabrata Debnath, stated, "Once you experience such synchronization, it's hard to go back to the previous state."
Currently, NeuralGarage has partnered with major brands such as Amazon India and Coca-Cola, helping the advertising industry quickly update video content for various holidays or promotional events. Debnath mentioned that Amazon India has recently begun utilizing this technology to apply the same video material to different seasonal marketing campaigns.
In the film industry, NeuralGarage collaborates with film distributors like Europa Movies, which holds a 95% market share, to help them tackle challenges related to global distribution, piracy prevention, and dubbing synchronization.
Despite the enormous potential of NeuralGarage's technology, it still faces many challenges. One major issue is ensuring a seamless integration of facial adjustments with high-quality video while adapting to different camera angles and lighting conditions. Additionally, the technology needs to maintain a natural appearance when handling facial expressions of high-profile actors to avoid an "artificial intelligence feel."
To stay competitive, NeuralGarage plans to expand its market influence further by 2025. The company successfully raised $1.45 million in funding from Xfinity Ventures in 2022 and is currently preparing for a Series A funding round to scale its operations and enhance its products.
Key Points:
🌟 NeuralGarage uses AI technology to resolve the issue of mismatched dubbing and lip movements, enhancing the viewing experience.
📈 The company has partnered with well-known brands such as Amazon India and Coca-Cola to facilitate flexible updates to advertising content.
💼 NeuralGarage plans to expand its market influence by 2025 and is preparing for a Series A funding round.
