[erichocean]

> in which case you kind of already knew what was in the scene

It's almost like I wrote "scene parameters" for a reason.

More info here: https://blog.qarnot.com/an-overview-of-differentiable-render...

> While these techniques came closer and closer to photorealism, another question arose: what if instead of going from a 3D scene to a 2D image (rendering), we went from a 2D image to a 3D scene? As you may imagine, reconstructing 3D scenes from 2D information is quite complex, but there have been many advances in the last few years. This area of study is called inverse graphics.