Hacker News new | ask | show | jobs
by jstx1 1189 days ago
> ML/LLM does not fundamentally understand the code.

It doesn't need to understand it, it needs to have correct output often enough. At some point it gets so good at producing code, and so good at explaining code too, that the behaviour is indistinguishable from understanding and that's good enough.

1 comments

> It doesn't need to understand it, it needs to have correct output often enough.

Which explains the bullshit output it generates often enough. A software engineer would be able to detect this rather than a normal user trying to code. That is the point of the parent comment. It is the same with lawyers, doctors, investment bankers and bankers.

There is no fundamental 'breakthrough' in GPT-4 other than training it on more data and super computers. It is still a black-box neural network 'AI' not able to understand its output and give a transparent explanation about its choice of words.

OpenAI (Microsoft) has just gotten better at marketing stunts like this. What they say publicly about their own products turns out to be a different reality.