[bertdb]

Could the NeRF be replaced with a voxel grid, backpropagating to the voxel color values directly? Or is there a reason that wouldn't work?

[poolio]

should work, and there are tons of new differentiable mesh and volumetric representations to try!