[gorkish]

I am extremely excited for this technology to mature to a point where realtime novel view synthesis becomes possible. The idea of being able to take a few photographs and be able to recreate an appreciably decent 6DOF viewing experience is a very powerful enabling technology.

Nerfstudio looks like something that is finally accessible enough that I will be able to start experimenting without having to spend enormous amounts of effort on tooling. Can't wait to check it out! It looks like some of the processing pipelines might be a good fit for merging with WebODM to make it even more friendly to work with.

[moron4hire]

Real time novel view synthesis is already possible. In fact, I recently saw someone demo a version that ran in WebGL2 shaders on smartphones, so it's not terribly taxing.

https://mobile-nerf.github.io/

https://mobilenerf-webxr.fern.solutions/

[gorkish]

Thanks very much for the reference. I'm curious about this but unfortunately not enough to keep up with the nooks and crannies where it's being worked on!

[amelius]

> The idea of being able to take a few photographs and be able to recreate an appreciably decent 6DOF viewing experience is a very powerful enabling technology.

My understanding is that you can't just take a few photographs, but you have to label them with their position and orientation, which is often not trivial.

But perhaps this difficulty has been solved already (?)

[krasin]

Usually, you can just run COLMAP ([1]) and it will find the poses and camera intrinsics. This is indeed what Nerfstudio recommends doing in the docs ([2]).

1. https://colmap.github.io/

2. https://docs.nerf.studio/en/latest/quickstart/custom_dataset...