[smusamashah]

Article doesn't clearly tell what its doing.

Is it training a model based on 3d model? Is it doing img2img? is doing video2video using 3d video/image as source?

Article is showing off stuff but is light on explanation of what is going on here.

Also, the person is bearded. Hard to notice face changes there. I want to see more demos but instead of a 3d like render, do a realistic render without beard etc.

edit: Plus these are very short clips. 3D should theoretically help, but this article could have been better.

edit2: in the anime example, the girls face is definitely changing (+lips are not correct). It feels like you are doing img2video here?

[TobiasEnholmX]

Appreciate the feedback! Sounds like you're looking for more of a deep dive into the tech and how it works. This post was more about showing results, but we’ll cover the process and technical details in another one