[TaylorAlexander]

Their AI system has something called “shadow mode” where it can make observations without having any effect on the car. When Tesla needs to collect a dataset of something, like short videos of cars that put on their blinker but did not change lanes, or partially obscured stop signs, they can train a net to run in shadow mode on all their cars and collect more of this edge case. I presume that they also collect a lot of data around disengagements. And then they send the data presumably over Wifi when the customer gets home, or otherwise over the car’s 3G connection. But they collect targeted data, not mass dumps of drives.

Andrej Karpathy has described this system in various talks including on Tesla AI day.

[317070]

As I understand it, it's mainly collected when the car goes in for maintenance.