[andybak]

Unless we're talking about different things - it already exists. There's two parts to it - estimating a depth map ("monocular depth estimation") and inpainting the occluded parts.