Hacker News new | ask | show | jobs
by daenz 2440 days ago
>We’ve trained a pair of neural networks to solve the Rubik’s Cube with a human-like robot hand. The neural networks are trained entirely in simulation

Simulated training is so cool. Related, is anyone interested in a plugin for Blender that allows you to easily build physically-accurate simulation environments for robots and then apply reinforcement learning to the virtual robots? I have a hodge-podge amount of code for doing exactly this, and I'm curious if anyone else would be interested in it?

7 comments

Personally I think it would be useful to focus on the "easily build physically accurate simulation environments for robots" using blender part. IMO it makes the most sense to try and make this created environment into an OpenAI gym environment so that way most of the existing RL algorithms can be applied to the robots. If you do want to spin your own RL this approach does not stop you from doing so.

AFAIK there are a lot of publicly available RL algorithms out there, but not many (any) blender like interfaces to make physically accurate simulations.

The trick here isn’t “accurate” simulation, it’s that they used a bunch of different simulations with randomly perturbed physics and the RL learned policies that worked across these wide range of “realities”.
Yes please!
Yes, I'd be interested.
Also Yes, please!
Also yes, please!
Yes, absolutely