Hacker News new | ask | show | jobs
by voltaireodactyl 451 days ago
I want to be on board with the “bring more audience” but the truth is knowing how this industry works, any success with AI on this front will lead almost immediately to a total drying up of funding for professionals engaging in this work currently. I hope I’m wrong, I really do.
1 comments

What professionals are doing this work already? As I understand it, this is something that can only be done by AI (or by shooting the movie twice in different languages).
audio dubbing and voice acting is a thing. They even do it in a way that takes into account the mouth movement length/timing, to make it look slightly more natural a dub.

of course, it's not super good imho, and personally i prefer subtitles with the original audio. Even if ai did a perfect job, including changing the film's frames to suit etc, i dont believe the outcome is sufficient. I want the original actor's voice timbre and intonations, which has meaning, and is lost when translated to a different language.

This is using the original actor. They re-recorded it. The AI just modifies the lips.

From TFA:

> Notably, the original actors recorded their own dialogues in English in a sound booth — Flawless AI's technology merely altered the movements of their lips in the movie.