[Budabellly]

I'm with you that I doubt there are GANs running in real time here, however I don't know see why they wouldn't be using similar models for offline static asset generation.

As far as scans go, it's much cheaper than you would imagine to get high quality face scans. Rigging them for animation is the real challenge, and I'd be really impressed if they were using GANs for rigging.

For state of the art in this space.. check this out: https://twitter.com/ak92501/status/1311832183078879232

[Arelius]

Yeah, getting face-scans is cheap and easy. but cleaning them up for real-time rendering, skinning, and rigging as you mention is a huge pain. And then going from there to a generalized model is pretty crazy.

I can imagine they might be using scans that they fit their model to to generate some blendshapes, but it's just as likely that they don't.

[Arelius]

Also, nice paper. An initial read of it though suggests it's only capable of building a set of textures and blendshapes, which implies that the actual topology is still in the realm of "artists" We really have no idea how to deal with geometry in ML.