Hacker News new | ask | show | jobs
by guld 536 days ago
Really cool project.

Some questions to ML/AI researchers here on HN:

- Are there any ML/AI papers out there that trained on this? E.g. training robots in virtual environments?

- What data sets are used today in the ML/AI space to train robots?

2 comments

From the video: "Infinigen is 100% procedural. Math rules only. Zero AI. Just graphics."

.

Timestamp: https://youtu.be/6tgspeI-GHY?t=107

"Zero AI" - nice to end the year with something so refreshing!
He’s asking if anyone is training using data created from a system like this, not if this uses AI.
The question wasn't "does this use AI". It was, "does any AI use this".
Exactly, thanks.

Did some light digging and found some related papers:

- https://robogen-ai.github.io/

- https://genesis-embodied-ai.github.io/, related HN thread: https://news.ycombinator.com/item?id=42457213

- https://paperswithcode.com/datasets?q=robot&v=th&o=match

These use other data sets, however.

I'm pretty sure i saw a video from Nvidia research using generated environments for training robots etc.

Can't find it quickly though.

Nvidias Omniverse is one of the core things though

If you look up the nvidia keynote from 2024, omniverse, robotics, and digital twins are discussed at length [1]. The relevant parts are near timestamp: 1 hour 34 minutes

[1]: https://www.youtube.com/live/Y2F8yisiS6E