[PawBer]

Looks like they didn't teach the model about airplanes.

[sorokod]

Perhaps should be a warning on the label. Something like:

"Training corpus did not include airplanes, people in wheel chairs,..."

[twayt]

That is going to be an infinitely long warning label

[pessimizer]

They can post it on all of your doors as a TOS for leaving the house. If you want to sue, you'll have to prove you climbed out of the window.

[lordnacho]

Models need to generalize over what they've been shown though. Most people won't learn to drive near an airplane or a wheelchair either, but would have no problem avoiding those.

[trhway]

Humans generate general 3d representation of the world. You don't know what this object is, yet you see it's borders. Tesla seems to generate understanding only of the objects that it has already seen.

[rasz]

"...any animals, ..."

[trhway]

I can imagine a PM meeting at Tesla triaging the issues - "severe bug, yet very rare, waiving it for this release."

One can also imagine their modelers populating the synthetic training world with all of the planes right now. Like a "Mria" coming right in front of you on 101, as well as F-35 passing you on the left, and of course Millennium Falcon dropping right on you, and all that happening on a flight deck of huge aircraft carrier.

[raverbashing]

Aggravating edge cases: you use the feature in an environment where not even 0.01% (optimistically) of drivers will drive

[lm28469]

There are a lot of 0.01% cases when you have 600k+ tesla driving out there... and it's only the beginning

[salawat]

If your ML was half as generalized as you make it out to be it would not be a problem.