[cshenton]

This is super cool. Might be replacing something I've been building with it.

Are there any benchmarks I could check out? Especially for a3c.

[AlexKuhnle]

Hey, glad you like it! We haven't properly benchmarked our models yet, but it's one of the things at the top of our ToDo list. (However, we will only run benchmarks on some selected "standard" environments, given our limited resources.)