[frik]

Does this new Telsa autopilot use stereo cameras? Would stereo camera help to have a better 3D vision? Or is a video stream enough to get the 3D data.

From the video it looks like lane detection and 2D object recognition.

It might use a structure-from-motion (SfM) running on CUDA to get a 3D point cloud out of the 8 cams. Does someone know more about how their new auto pilot works?

[hwillis]

They do not. They have 3 forward cameras (1), but they all point directly forward and are for separate use cases. I've always thought it would make more sense to have two cameras at either side of the windshield rather than one in the middle. The downsides are you need a new method to clear water and debris since the wipers won't hit that area, and there might be limited FOV.

Stereo might require some level of calibration to account for camera alignment, maybe they want to avoid that? I would think that implementing stereo would be fairly cheap both computationally and in hardware- if they can get by this well without it, they could pare the stereo computations down to a few frames per second, on specific objects in the scene. Maybe a future update will add binocular cameras in the dash, but they are pretty confident about their current hardware.

1: https://www.tesla.com/en_EU/autopilot

[deepnotderp]

I'd imagine they use stereo cameras. AFAIK though, their main sensor is radar.