Groundbreaking artificial neural networks and new deepfake technology take dubbing industry to the next level.
Deepfake dubbing as new dimension of Artificial Intelligence will help translate movies and series without losing an actor’s original performance when facial movements may clash with his lines.
Deepfakes in this category focus on the movement of mouth and create lip movements that match the translated speech and paste them automatically onto the actor’s head.
In this case, when someone watches dubbed movie or series, a mistimed mouth movement is less likely to occur.
An actress who saw herself speaking Spanish said to the media that “I think this is the best way to be able as an actor to preserve your performance” in another language,
The new facility for dubbing projects identifies key points on a person’s face and uses machine learning to capture how that person’s face moves.