[joshvm]

Yup, this is called shape from silhouette. Quite a lot of research on it over the years:

https://www.cvg.ethz.ch/teaching/compvis/2011/lecture/vision...

EDIT: Better link

[eon1]

See also: Visual Structure from Motion, which I believe works off static light sources (same stuff you see in 123D Catch and similar software, this one is free though).

http://ccwu.me/vsfm/

For a less detailed/easier to use process, you can also try Regard3D: http://www.regard3d.org/

[jsch]

Another open-source, full 3D reconstruction pipeline is COLMAP: https://colmap.github.io/