Deepdub has unveiled AI dubbing technology that can change a speaker’s accent.
Tel Aviv, Israel-based Deepdub is introducing its Accent Control technology, which uses proprietary generative AI to enable content creators to precisely control the accents of characters when dubbing content into another language, ushering in a new era of authenticity for AI-dubbed material.
In the realm of entertainment, characters like Shrek, Jack Sparrow, and Hannibal Lecter are eternally linked to their distinctive accents. The challenge arises during the traditional dubbing process, where directors must grapple with the decision to preserve these original accents for authenticity or adapt them to align with the cultural nuances of the target audience.
Until now, AI dubbing has streamlined localization efforts but lacked the ability to offer control over how accents manifest in dubbed content. Ofir Krakowski, CEO of Deepdub, clarified that the AI technology does not replace voice actors but rather enhances opportunities for individuals to access new roles.
GB Event
GamesBeat Summit Call for Speakers
We’re thrilled to open our call for speakers to our flagship event, GamesBeat Summit 2024 hosted in Los Angeles, where we will explore the theme of “Resilience and Adaption”.
Apply to speak here
Deepdub’s Accent Control technology leverages custom generative AI models, empowering content creators to manipulate and control character accents in dubbed content with authenticity and flexibility.
This tech enables creators to retain the original accents or adapt them to seamlessly fit the dubbed material and the cultural expectations of the target audience. By doing so, Deepdub ensures that the emotional and cultural nuances of performances remain intact, enhancing the overall viewer experience.
“Audiences crave genuine experiences, and our Accent Control technology marks a significant milestone in achieving that,” said Ofir Krakowski, CEO of Deepdub.
Accent Control is powered by Deepdub’s emotional text-to-speech (eTTS) 2.0 model, a multimodal Large Language Model supporting over 130 languages. Developed by Deepdub’s research team, this model generates emotionally expressive speech and has emergent capabilities for manipulating speech characteristics, including accents.
Deepdub is actively working on expanding Accent Control to include support for regional accents, enabling micro-localization in dubbed content.
Accessible through the Deepdub Go platform, a virtual AI dubbing studio tailored for post-production editors, the technology offers an intuitive interface for applying and adjusting accents. It is also available through Deepdub’s white-glove dubbing service, featuring the expertise of an in-house team of post-production and localization professionals.
Deepdub’s advisory board includes media executives such as Kevin Reilly, former Chief Content Officer at HBO Max, and Emiliano Calemzuk, the former President of Fox Television Studios.
The company, with 34 employees and $20 million in funding, continues to innovate in AI-driven localization solutions.
GamesBeat’s creed: “where passion meets business.” GamesBeat aims to inform and engage readers about the gaming industry, offering insights from both a business perspective and a fan’s viewpoint. Check out our Briefings for more information.