Very cool! Would it be possible to use this for NeRFs? I’m very new to them but it seems like they use light data heavily, at least it seems Luma AI does.
I'm not sure if you're already aware of the connection, but the founder of Lytro (Ren Ng) was actually the advisor on the original NeRF paper! I took a graphics class from him in college and it was one of my favorite classes. In addition to the course material it was great to hear about what his lab was working on and future moonshot projects.
It wouldn't make sense to use these for nerfs because of the variable focus... and the low resolution. The depth prediction used by NERF is also miles ahead of the depth maps produced by lytro cams.