[jamesrom]

It never made sense to me why they raycast from the car. Humans don't play this way. The car is an abstraction the model doesn't need to care about it.

It literally doesn't matter if it's 1px or 100 meters to the wall, just learn to not hit it.

Instead, measure from the _camera_. That's all that matters. That's what humans do when we play.

Bonus: with this added perspective you'll be able to drive maps with hills and jumps. Not just flat maps.

[317070]

RL expert here, the problem with vision is that most likely, it takes too long to render and to process the render in your NN.

At that point you need to run the game real-time instead of faster, so you need a lot of compute to generate your data. You will also need the bandwidth to throw the data around, and the GPUs to take all that input size.

It's definitely possible, but not the place to start, and will require a lot more compute infrastructure.

[jamesrom]

I’m not saying render the scene. I’m saying take your measurements from where the camera is (or would be).

It would require no extra infra or compute.

[msephton]

They're driving non-flat maps by the end of the article and in the subsequent article. AFAIK they can only go with what they see on screen, there don't have access to camera rendering data.

[jamesrom]

I’m not saying render the scene. I’m saying take your measurements from where the camera is (or would be).