Hacker News new | ask | show | jobs
by adamjcook 1106 days ago
In my view, the higher-level issues with the FSD Beta program are:

- A failure by Tesla to view the system that they are developing as what it really is - a physical safety-critical system and not "an AI". Those two are distinct systems as, with a physical safety-critical systems, the totality of the systems safety components cannot be fully expressed in software - neither initially nor continuously.

- To build on that point, Tesla is not allowing the Operational Design Domain (ODD) via a robust, well-maintained validation process determine the vehicle hardware as the ODD demands it to be. Instead, Tesla is trying to "front run" it (ignore the demands of the ODD) by largely focusing on hardware costs. The tension from failing to recognize that is why Tesla, in part, has a long history of being forced to (somewhat clandestinely) change the relevant sensor and compute hardware on their vehicles while promising to "solve FSD" (whatever that means) by the end of every year since around 2015 or so.

1 comments

> and not "an AI"

But what is AI? If it's just "artificial intelligence", it effectively includes all programming with if/then logic gates based on program input.

> it effectively includes all programming with if/then logic gates based on program input.

And? You think that is the totality of a physical safety critical system?

I'm pointing out that calling anything "AI" is both pointless and meaningless. It's a buzzword for board members and shareholders to throw around, since they refer to it as the latest LLM technology, while the phrase just means any complex business logic generated by a program.
It’s generally accepted to mean the use of neural networks which Tesla is obviously using. Good luck even identifying a stop sign with “complex business logic” or “if/else”
Most important road signs have rather distinct shapes, standardized sizes and are angled towards oncoming traffic. Having an object with known shape aligned almost perfectly towards the camera is basically the best case for many primitive object detection algorithms.
True, but it’s equally important that a self-driving car be able to recognize a stop sign that is bent from a previous accident and facing an arbitrary angle (as well as one that is angled towards the car’s lane but applies to a different road).
They're "artificial neural networks" and it would seem to me it's recognizing stop signs by comparing them to images of stop signs. So I tend to lean toward "AI" is the latest "buzzword". I think in truth it's more akin to a search engine reacting to inputs, but from sensor data, than anything close to real "intelligence" of any kind.

I can see how it appears to intelligent, but it lacks reasoning, creativity, and critical thinking.

If I had a fully functional self-driving car, I wouldn't be lamenting that it wasn't creative enough