[corobo]

I'd be super interested in seeing how this reacts to having a single star wanted level. At that level police cars will come to a stop almost perpendicular in front of your car. Will the AI be able to avoid an aggressive obstacle.

Also it'd be interesting to see how it reacts to getting shot at

[mtrycz]

I'm missing (and the article doesn't exactly state) what the fitness function is here.

It might just as well don't care about being shot at.

[cr4zy]

We currently don't look at being shot at (although it's an interesting suggestion!) - the current reward function is basically this:

  distance_reward - off_road_penalty - speeding_penalty - slow_penalty - discomfort_penalty;

Plus if you collide or drive against traffic, the episode terminates.

https://github.com/openai/universe-windows-envs/blob/f5aad96...

[corobo]

Well that part was mostly a bit of a joke - It could add in a few interesting variables such as deflated tyres causing the car to drift more than the AI is expecting.