[andix]

As far as I know humans can also safely drive only with one eye. It’s perfectly legal in most countries.

But I agree that current software (Tesla?) is not able to do that in the same way. So it may need more sensors until the software gets better.

In theory cameras should also be able to see more than humans. They can have a wider angle, higher contrast, higher resolution and better low-light vision than the human eye.

[cratermoon]

A human with one eye can use slight head movements and eye to gain a sense of depth. Perhaps the mono cameras need some kind of mount that allows them to not only look around but also move in 3 dimensions. That seems more complex than just having binocular cameras, though.

[ikhatri]

Yup! This kind of reconstruction is known as multi-view reconstruction. Though the cameras don't need to have a movable mount, they're already on a car which moves! The car moves and gives them a new "perspective" at every frame. That's how some monocular systems already work. Here's an example of one such system: https://github.com/nianticlabs/manydepth

That said, I think what you're referring to is more extreme perspectives that shift in ways the car cannot drive and you are correct that this would aid in reconstruction. This is how NERF models do their 3D reconstruction (https://nerfies.github.io/).

[m463]

like pigeons.

Can't cameras do this by just comparing frame 1 to frame 2?

[cratermoon]

Compare how?