[NewJazz]

The fundamental difference between asking on SO and asking an LLM is that SO is a public forum, and an LLM will be communicated with in private. This has a lot of implications, most of which surround the ability for people to review and correct bad information.

[dbobbitt]

The other major benefit of SO being a public forum is that once a question was wrestled with and eventually answered, other engineers could stumble upon and benefit from it. With SO being replaced by LLMs, engineers are asking LLMs the same questions over and over, likely getting a wide range of different answers (some correct and others not) while also being an incredible waste of resources.

[nprateem]

Surely the fundamental difference is one asks actual humans who know what's right vs statistical models that are right by accident.

[ijidak]

Providing context to ask a Stack Overflow question was time-consuming.

In the time it takes to properly format and ask a question on Stack Overflow, an engineer can iterate through multiple bad LLM responses and eventually get to the right one.

The stats tell the uncomfortable truth. LLMs are a better overall experience than Stack Overflow, even after accounting for inaccurate answers from the LLM.

Don't forget, human answers on Stack Overflow were also often wrong or delayed by hours or days.

I think we're romanticizing the quality of the average human response on Stack Overflow.

[matt_kantor]

The purpose of StackOverflow was never to get askers quick answers to their specific questions. Its purpose is to create a living knowledge repository of problems and solutions which future folk may benefit from. Asking a question on StackOverflow is more like adding an article to Wikipedia than pinging a colleague for help.

If someone doesn't care about contributing to such a repository then they should ask their question elsewhere (this was true even before the rise of LLMs).

StackOverflow itself attempts to explain this in various ways, but obviously not sufficiently as this is an incredibly common misconception.

[fireflash38]

That's only because of LLMs consuming pre-existing discussions on SO. They aren't creating novel solutions.

[specproc]

What I'm appreciating here is the quality of the _best_ human responses on SO.

There are always a number of ways to solve a problem. A good SO response gives both a path forward, and an explanation why, in the context of other possible options, this is the way to do things.

LLMs do not automatically think of performance, maintainability, edge cases etc when providing a response, in no small part because they do not think.

An LLM will write you a regex HTML parser.[0]

The stats look bleak for SO. Perhaps there's a better "experience" with LLMs, but my point is that this is to our detriment as a community.

[^0]: He comes, https://stackoverflow.com/questions/1732348/regex-match-open...

[stocksinsmocks]

Humans do not know what’s right. What’s worse is the phenomenon of people who don’t actually know but want to seem like they know so they ask the person with the question for follow up information that is meaningless and irrelevant to the question.

Hey, can you show me the log files?

Sure here you go. Please help!

Hmm, I don’t really know what I’m looking for in these. Good luck!