[dwallin]

Is this paper achieving what you mean: https://arxiv.org/pdf/2311.16728.pdf

Caveat, this field is far outside my wheelhouse. So if not, I'd love to understand more about the nuances here.

[markisus]

I don’t think this is realtime reconstruction, meaning that changes in the scene will not be represented in the reconstructed map immediately.

[smusamashah]

The Splatter Image paper recently featured on HN seems to do that though https://news.ycombinator.com/item?id=38720226