[sorenjan]

Personally I don't think NeRFs are an elegant way of representing scenes, I'd prefer something more structured than a blob of weights. But maybe it's still a good intermediary to go from images to the final form, I'm far from an expert.

[flor1s]

Weights are just numbers, essentially by using a neural network you are telling the system to "find the best way to represent the scene with a budget of X numbers/parameters". Modern NeRFs like instant-ngp also use some grid representations. I guess Gaussian Splatting is slightly more geometrically appealing because you get points around the surfaces that you are trying to model. These points are however not guaranteed to be exactly on the surface, which additional surface losses try to solve (e.g. NeuSG).