automatic French dubbing, HeyGen style

Conquering the world with your videos or podcasts will be possible very soon thanks to Lipitt, a French automatic dubbing platform, based on artificial intelligence, inspired by the American HeyGen. And the refinement goes, here too, to the resynchronization of the movements of the mouth.

It was a 23-year-old French engineer, Antoine Ménager, who decided to compete with the Americans from HeyGen on their own turf. Remember, last September, we discovered HeyGen, this amazing dubbing tool, capable of dubbing anyone, with their own voice, by matching the animation of the lips with the words. Striking effect, worldwide buzz.

But Antoine Ménager believes he can do better, and cheaper. Eight months ago, he started the Lipitt project. And since March 12, 200 additional people every day have had access to the beta version, a provisional version which requires registering on a waiting list.

Zendaya and Orelsan polyglots

Small demonstration with this interview with Zendaya by HugoDécrypte, posted online on LinkedIn by Antoine Ménager. We hear the heroine of Dune 2, first in English, then with her own cloned voice, in French, Turkish, Spanish and Chinese. It’s impressive, even more so when you have the image, with this mouth synchronization, whatever the language but since HeyGen, this is nothing new.

Lipitt adds several innovations compared to its American predecessor. The first innovation is the price. HeyGen works with credits. One credit equals one minute of translation. The minute costs around €1.50. With Lipitt, this price is halved: €0.70 per minute, for each language, and again, this price should quickly decrease.

Cloned voice and intonation

Second new feature: Lipitt clones not only the voice, but also the intonation, for even greater realism, which can even be refined manually. And then, the AI ​​already manages up to six interlocutors simultaneously. Perfect for a debate show! She even manages the voices on music, as in this clip of Orelsan, suddenly polyglot, and perfectly synchronized, an extract of which is also available on Antoine Ménager’s LinkedIn page.

However, the young Frenchman did not have the means for HeyGen. When the American platform raised 10 million dollars, Antoine Ménager only had €500,000 to create and launch Lipitt. Next step: the opening of Lipitt to everyone, and the launch of live dubbing, planned for early next year.