[pritambarhate]

Let's say there is an architect and he also owns a construction company. This architect, then designs a building and gets it built from of his employees and contractors.

In such cases the person says, I have built this building. People who found companies, say they have built companies. It's commonly accepted in our society.

So even if Claude built for it for GP, as long as GP designed it, paid for tools (Claude) to build it, also tested it to make sure that it works, I personally think, he has right to say he has built it.

If you don't like it, you are not required to use it.

[fauigerzigerk]

I agree that it's ultimately about the product.

But here's the problem. Five years ago, when someone on here said, "I wrote this non-trivial software", the implication was that a highly motivated and competent software engineer put a lot of effort into making sure that the project meets a reasonable standard of quality and will probably put some effort into maintaining the project.

Today, it does not necessarily imply that. We just don't know.

[pritambarhate]

Even with LLMs delivering software that consistently works requires quite a bit of work and in most cases requires certain level of expertise. Humans also write quite a bit of garbage code.

People using LLMs to code these days is similar to how majority people stopped using assembly and moved to C and C++, then to garbage collected languages and dynamically typed languages. People were always looking for ways to make programmers more productive.

Programming is evolving. LLMs are just next generation programming tools. They make programmers more productive and in majority of the cases people and companies are going to use them more and more.

[fauigerzigerk]

I'm not opposed to AI generated code in principle.

I'm just saying that we don't know how much effort was put into making this and we don't know whether it works.

The existence of a repository containing hundereds of files, thousands of SLOCs and a folder full of tests tells us less today than it used to.

There's one thing in particular that I find quite astonishing sometimes. I don't know about this particular project, but some people use LLMs to generate both the implementation and the test cases.

What does that mean? The test cases are supposed to be the formal specification of our requirements. If we do not specify formally what we expect a tool to do, how do we know whether the tool has done what we expected, including in edge cases?

[teiferer]

I fully agree with your overall message and sentiment. But let me be nit-picky for a moment.

> The test cases are supposed to be the formal specification of our requirements

Formal methods folks would strongly disagree with this statement. Tests are informal specifications in the sense that they don't provide a formal (mathematically rigorous) description of the full expected behavior of the system. Instead, they offer a mere glimpse into what we hope the system would do.

And that's an important part, which is where your main point stands. The test is what confirms that the thing the LLM built conforms to the cases the human expected to behave in a certain way. That's why the human needs to provide them.

(The human could take help of an LLM to write the tests, as in they give an even-more-informal natural language description of what the test should do. But the human then needs to make sure that the test really does that and maybe fill in some gaps.)

[halfcat]

> If we do not specify formally what we expect a tool to do, how do we know whether the tool has done what we expected, including in edge cases?

You don’t. That’s the scary part. Up until now, this was somewhat solved by injecting artificial friction. A bank that takes 5 days for a payment to clear. And so on.

But it’s worse than this, because most problems software solves cannot even be understood until you partially solve the problem. It’s the trying and failing that reveals the gap, usually by someone who only recognizes the gap because they were once embarrassed by it, and what they hear rhymes with their pain. AI doesn’t interface with physical reality, as far as we know, or have any mechanism to course correct like embarrassment or pain.

In the future, we will have flown off the cliff before we even know there was a problem. We will be on a space ship going so fast that we can’t see the asteroid until it’s too la...

[dirtbag__dad]

> Today we just don’t know

You never knew. There are plenty of intelligent, well-intentioned software engineers that publish FOSS that is buggy and doesn’t meet some arbitrary quality standards.

[onion2k]

the implication was that a highly motivated and competent software engineer put a lot of effort into making sure that the project meets a reasonable standard of quality and will probably put some effort into maintaining the project

That is entirely an assumption on the part of the reader. Nothing about someone saying "I built this complicated thing!" implies competence, or any desire to maintain it beyond building it.

The problem you're facing is survivorship bias. You can think of lots of examples of where that has happened, and very few where it hasn't, because when the author of the project is incompetent or unmotivated the project doesn't last long enough for you to hear about it twice.

[fauigerzigerk]

>Nothing about someone saying "I built this complicated thing!" implies competence, or any desire to maintain it beyond building it.

I disagree. The fact that someone has written a substantial amount of non-trivial code does imply a higher level of competence and motivation compared to not having done that.

[wahnfrieden]

Hand-written code never implied much about quality no matter the author, especially as we all use libraries of reusable code of varying quality

[foltik]

Agree that just being hand-written doesn’t imply quality, but based on my priors, if something obviously looks like vibe-code it’s probably low quality.

Most of the vibe-code I’ve seen so far appears functional to the point that people will defend it, but if you take a closer look it’s a massively over complicated rat’s nest that would be difficult for a human to extend or maintain. Of course you could just use more AI, but that would only further amplify these problems.

[fauigerzigerk]

Not much, but infinitely more than now.

If someone puts weeks and months of their time into building something, then I'm willing to take that as proof of their motivation to create something good.

I'm also willing to take the existence of non-trivial code that someone wrote manually as proof of some level of competence.

The presence of motivation + competence makes it more likely that the result could be something good.

[pbh101]

In general that is all implication and assumption, for any code, especially OSS code.

[dabber]

The original person didn't say "I wrote this non-trivial software", they said "I built Velo".

[fauigerzigerk]

...and pointed us to a repository containing non-trivial software.

[heliumtera]

We know. It is not difficult to tell them apart. Good taste is apparent and beauty is universal. The amount of care and attention someone put into a craft is universally appreciated. Also, I am 100% confident this comment was the output of a human process. We can tell. There is something more. It is obvious for those that have a soul.

[fauigerzigerk]

We know if we make the effort to find out. But what we really want to know is not whether AI was used in the process of writing the software. What we want to know is whether it's worth checking out. That's what has become harder to know.

[philipallstar]

Exactly. It's like looking at assembly that's been written by a person vs by a compiler. There's just no soul in the latter! And that's why compilers never caught on.

[greatgib]

The architect knows what it is doing. And the workers are professionals with supervisors to check that the work is done properly.

[heliumtera]

Every single commit is Claude. No human expert involved. Would you trust your company database to an 25 dollars vibe session? Would you live in a 5 dollars building? Is there any difference from hand tailored suit, constructed to your measurements, and a 5 dollars t-shirt? Some people don't want to live in a five dollars world.

[pbh101]

Most of the OSS projects on HN are not worthy for you to base your company on, especially sight unseen. Using an agent has nothing to do with it.

[wahnfrieden]

Agent authorship doesn't imply unreviewed or underspecified code

[heliumtera]

Vibe coded means precisely that!

[wahnfrieden]

Yes but there’s no evidence this is vibe coded or not. You’re cynically claiming it due to agent authorship. As if there is no legitimate use.

> No human expert involved

You don’t know this, you are just hating.

Besides the close review and specification that may be conducted with agents, even if you handwrite / edit code, it will say that it was co-authored by the agent if you have the agent do the commit for you.

[risyachka]

Asking someone to build a house - and then saying I built it - is "very misleading" to put it nicely.

When you order a website on upwork - you didn't build it. You bought it.

[victorbjorklund]

Plenty of architects claim ”this is my building” even if they didn’t pour all the concrete

[philipallstar]

> In such cases the person says, I have built this building

But this is also bad, because it's wrong. They drew it and maybe got some paperwork through a planning department. They didn't build it.

[rootnod3]

That has to be the worst analogy I have read in a while, and I’m HN that says something.

[happymellon]

That's a lot of ifs.

[testdelacc1]

What an outrageously bad analogy. Everyone involved in that building put their professional reputations and licenses on the line. If that building collapses, the people involved will lose their livelihoods and be held criminally liable.

Meanwhile this vibe coded nonsense is provided “AS IS”, WITHOUT WARRANTY OF ANY KIND, EXPRESS OR IMPLIED. We don’t even know if he read it before committing and pushing.

[pritambarhate]

Even billion dollar software products have similar clauses, it doesn't have anything to do with vibe coding. To build and sell software no educational qualification is needed.

Quality of the software comes from testing. Humans and LLMs both make mistakes while coding.

[tracker1]

As an autodidact, and someone who has seen plenty of well educated idiots in the software profession, I'm happy there are no such requirements... I think a guild might be more reasonable than a professional org more akin to how it works for other groups (lawyers, doctors, etc).

There are of course projects that operate at higher development specification standards, often in the military or banking. This should be extended to all vehicles and invasive medical devices.

[tracker1]

Depends on the building type/size/scale and jurisdiction. Modern tract homes are really varied, hit or miss and often don't see any negative outcomes for the builders in question for shoddy craftsmanship.

[pbh101]

Same with any OSS. Up to you to validate whether or not it is worth depending on, regardless of how built. Social proof is a primary avenue to that and has little to do with how built.

[pebble]

No, it's more like the architect has a cousin who is like "I totally got this bro" and builds the building for them.

[foobarbecue]

Right and also in this world there are no building codes or building inspections.