Hacker News new | ask | show | jobs
by Zetobal 899 days ago
It's a face ipadapter and still the abysmal wav2lip 128px model. The training code is open at least do yourself the favor and train it in a higher resolution instead of being one of X companies that does the same as everyone else.
1 comments
samspenc 899 days ago
As a noob in Generative AI, could you go into more details about the face ipadapter and wav2lip models? How were you able to figure out that OP was using these models?
link
Zetobal 899 days ago
The generated people have the typical face adapter bugs. You can learn about them here [0]. wav2lip is a old gan based model, the output produces a slight green tint. The rest of the animation is just animatediff.

[0] https://www.youtube.com/watch?v=t2OBzV3UHv4

[1] https://github.com/Rudrabha/Wav2Lip

link