[nl]

Yes, I agree this is a potential way forward.

I believe there are three problems:

* There isn't software that generates point clouds from video games. This should be solvable but AFAIK hasn't been done yet.

* The diversity of models in video games is much lower than the real world

* Games use a bunch of techniques to reduce the poly count while making assets look like they are high poly (eg texture mapping). It's unclear what should be generated here.

Take a look at the field of NeRFs (Neural Radiance Fields: https://datagen.tech/guides/synthetic-data/neural-radiance-f...) for more on this subject.