Or build a camera with multiple sensors capturing different FoVs.
Samsung have published papers on a 1.2MegaPixel ToF sensors, but currently only have a VGA sensor available. https://ieeexplore.ieee.org/abstract/document/9365854 https://www.samsung.com/semiconductor/minisite/isocell/visio...
I'm glad to see we're steadily climbing in terms of sensor resolution. We're not anywhere close to 4K 120Hz sampling, but the field is progressing.
There's nothing stopping us from doing offline processing for our workflow, I suppose.