[smusamashah]

Check out zip nerf which seems to do exactly that https://jonbarron.info/zipnerf/

[ge96]

looks amazing, my naive take is ML is a brute force way to do something, not guaranteed to be correct but close enough

on the other hand, I'd be curious how much worse a procedural way to do frame by frame analysis would be