Isn't that the exact type problem that massively benefits from having tons of real world data because they will have examples to train their neural nets for practically every possibility?
Not really. Neural nets are good at detection and classification problems for objects in the environment but they are not a panacea. Assuming a neural net is good enough to detect everything a car will see (for pedestrians this isn't the case) path planning while predicting behavior of other actors is still a very difficult unsolved problem.