[tristor]

My observation is that AI tools generally make people /less/ productive. They are more productive in that they produce more stuff, but they are less productive in that the stuff they are producing has lower inherent value delivery. The primary place where I see this in software teams as a Product person is in document creation. If you are using an AI tool to produce internal documents, this is likely a net-negative value activity that actually reduces the overall productivity of the team. Why? Because writing is thinking. By handing off document creation to an LLM for a document that's supposed to communicate important details between teams (e.g. technical design docs, requirements docs, strategy docs) you are actually handing off thinking, or rather handing off not-thinking as AI tools cannot "think". The outcome of is poorly "thought out" slop that generates more work for everyone involved to resolve /or/ everyone simply ignores the document and the previous processes stop being useful.

If anything, I'd say AI tools in /most/ enterprises as people are trying to use them now are at least a -30% of productivity. If used correctly for taking a human-written/thought requirements doc, converting it into an interactive prototype that can be critiqued and ultimately included as part of the solution alignment within the requirements doc, and then is handed to an engineering team that is effective at using humans and AI to produce code, then it's probably a benefit. But most businesses lack the internal rigor, quality culture, and data governance to support properly applying AI tools in a high context manner internal to their business.

[wannabe44]

Have you worked with codebases where people produced slop even before LLMs? In such codebases LLMs are a godsend. They can churn around huge amounts of code and find needles in the haystack.

[tristor]

Since I'm on the Product side these days, I don't spend much time delving into the codebase at this point in my career. I can believe it though, as I've done quite a few personal side projects using langchain and various harnesses. The problem I see is not necessarily that LLMs build things badly (although I know that can also be true), its that because people are using LLMs to generate documents, we are then building the wrong thing entirely (whether with an LLM or not, whether badly or not).

Removing human thought from the process of development is generally a net negative, IMO.