Amazon Prime Video uses AI to improve lip sync in dubbed Maxton Hall

In short: Amazon Prime Video has started using a feature it calls Visual Dubbing to digitally adjust actors’ mouth movements so dubbed dialogue looks more in sync.

What happened

Amazon Prime Video is using a mix of AI and visual effects to change how actors’ mouths move in dubbed versions of the German series Maxton Hall. The goal is to make the on-screen lip movements match the translated audio that viewers hear.

Amazon calls the feature “Visual Dubbing.” Think of it like carefully re-editing the actor’s lips in the picture, while leaving the spoken performance alone.

The company is starting with Maxton Hall. Amazon says the English-dubbed versions of seasons 1 and 2 are already available with adjusted lip movements.

Amazon also says the same treatment will be ready for the show’s third season. That season is set to premiere on December 9, 2026.

Importantly, Amazon says the voices are still recorded by human actors. The AI is only used to change the visuals, meaning the mouth and some face movement, not to create or replace the audio.

Why it matters

Dubbing often looks a little off, because the original actor spoke a different language and mouth shapes do not line up perfectly. By making the lips better match the translated words, Amazon is trying to make dubbed shows feel more natural for viewers who prefer watching in their own language.

Amazon has said it plans to expand Visual Dubbing to more titles beyond Maxton Hall.

Source: NYTimes