In my autopilot gen 1 Tesla, when the software was first released, lane markings had to be really clear, but as the software has matured, it now does less than perfect lane marking in pretty heavy rain without issue.
Holistic path planning uses the entire scene to identify the lane, not just the lane markings.[1] This is exactly how a human drives on a rural road.
Once enough fleet learning data is gathered, high resolution maps will mark out the road surface to high accuracy (cm).
Of course that's no good unless the car knows where it is within cm! For this Tesla uses sensor fusion with GPS, an onboard IMU (similar to a smartphone), four wheel wheel odometry (via the ABS sensors), steering angle, and torque delivery. Owners report that the Autopilot 1.0 cars know their position in a parking space to within about 10 cm. And it has demonstrated high accuracy and low drift in no-GPS situations[2].
This type of sensor fusion (Kalman filtering) was originally developed for the Apollo spacecraft, and was one of the responsibilities of the famed Apollo Guidance Computer.
I think the current-gen autopilot vision code is a completely different codebase from a different supplier running on different hardware than the gen 1, though, so all those improvements have probably been thrown away.
Despite the different codebases, they still have the datasets that they've collected over the years, and that's really what matters (for things like lane detection.)
It would be quite weird if they didn't retrain their new models with all that data.
What does this mean? So they send all 8 video cams data to Telsa? This would mean ould mean very high upload traffic and costs - sounds unrealistic. I assume Tesa sends the GPS data, and sensor data and maybe occasional photos back to HQ, but not full videos of all 8 cameras - or do you have a source/reference?
Actually, i think in AP 1 they used MobileEye and Tesla has their custom software to compliment it and with the switch to AP 2 "It runs a Tesla-developed neural net for vision, sonar, and radar processing." https://cleantechnica.com/2016/10/25/inside-nvidias-new-self...
So it seems like the analogy is more akin to Xbox 360 and Xbox One, hardware got an upgrade but they were able to run Xbox 360 games on it with some work.
I know I'm probably gonna get downvoted, but I cannot not bite. I'm super happy I kept my Saturn games. I still play them occasionally and some of them are very valuable now. I also hope you meant PS3 or PS4 when you said "PlayStation" and were not trying to revive a long gone console war that was very painful for some of us.