[junyanz]

It's possible. But 3D data (3D models, videos) are much more difficult to model via a deep neural net. While most of the researchers focus on modeling 2d images in recent years, there are a few work on 3D. For example, here is a project on modeling 3D objects like chairs and tables. https://arxiv.org/abs/1411.5928

[rl3]

Thanks for the reply. As coincidence would have it, this appeared on HN just a couple hours after, referencing the same paper:

https://news.ycombinator.com/item?id=12581420

Appears to be fundamentally 2D, but the interpolation between orientations gives it a sort of meta 3D aspect.