[uptown]

First heard this concept mentioned at SIGGRAPH in 2005 as “dual photography”. Here’s the paper:

https://graphics.stanford.edu/papers/dual_photography/