D-ID launches an AI video translation tool that includes voice cloning and lip sync

D-ID, an AI video creation platform, has introduced a cutting-edge tool for translating videos into different languages using AI technologies. What sets D-ID apart is its ability to clone the speaker’s voice and synchronize their lip movements to match the translated words during the editing process.

This innovative technology builds upon D-ID’s previous success in animating family photos and bringing them to life with speaking capabilities. Following a successful Series B fundraising round of $25 million in 2022, the company has focused on serving its growing number of enterprise customers in the U.S. who are utilizing AI-powered videos for various purposes.

The recently launched AI Video Translate feature by D-ID offers creators the ability to automatically translate their videos into 30 different languages, such as Arabic, Mandarin, Japanese, and more. This tool, currently free for D-ID subscribers, aims to assist creators in expanding their audience reach without the need for costly localization efforts.

By leveraging AI technology, D-ID’s Video Translation can help customers save on localization costs, particularly in marketing, entertainment, and social media sectors. This technology competes with other solutions for dubbing and AI video creation, offering a more accessible and affordable option for content creators.

Various companies, including Microsoft and Vimeo, have already integrated AI into their video translation and dubbing processes, demonstrating the industry’s shift towards advanced technologies. Tools like voice cloning and AI translation are becoming increasingly popular, with companies like Descript, ElevenLabs, and Speechify leading the way.

Dubbing and lip sync AI libraries, such as wav2lip, have simplified the process of creating voice cloning and translation tools, making them more accessible to startups and creators alike.