Hacker News new | ask | show | jobs
by astrange 979 days ago
You should be able to do relighting with ControlNet. Basically render the model to all the maps you'd use for PBR (fullbright color/depth/reflectivity/etc), train ControlNets that hold all those constant and do img2img but let it make up the background.

Though I'm not aware of anyone already doing this, since I think research has moved on to NeRF models that act on 3D scenes directly.