[mattgreenrocks]

Is there evidence of this happening yet?

It makes sense in theory, but this is the type of thing I want to see data on before I consider it a possible problem, even.

No sense in worrying about things that you can't control, can't prepare for and have not occurred yet, after all. :)

[ideamotor]

Perhaps. Not exactly evidence but I see this on drudge today: https://www.wsj.com/tech/ai/news-publishers-see-googles-ai-s.... I like your response though, funny! I find myself checking the dates of articles to see if it’s before ChatGPT. And I find myself responding less online because I don’t know if a human is on the other side. Calcification of human communication, is the biggest threat. I … think … you are human though!

[com2kid]

> Is there evidence of this happening yet?

Right now, today, when choosing a library, top of my mind is "has this been around long enough to be in GPT4's training set?"

Because to give up the 5-10x productivity boost GPT allows for, a library better be really good.

[datadrivenangel]

It'll be a moot question when OpenAI starts building a RAG index of the internet to provide up to date answers... almost like a page rank...

[com2kid]

It is not just a pure RAG index, it is having enough source material and tutorials to draw upon such that "best practices" for a given library or toolset get encoded into the model.

I've seen a couple companies offer a RAG enabled ChatGPT for their SDK, but without a large number of stack overflow and medium posts detailing how to use the SDK in different scenarios, well, there isn't much help an LLM can offer that I cannot just get from whatever is on a company's site.

Back in the day Microsoft used to pay boat loads of money to have absurdly complex sample applications shipped alongside new libraries and SDKs. The sample apps were often fully featured end to end solutions that had been gone over by testers as well.

The idea being, since there wasn't any really good online help back then (aside from news groups and such, which were useful if you knew about them), you had to rely on sample code or on books, books which Microsoft also commissioned to be written.

Maybe someday we'll get back to that point, companies paying money for large volumes of sample code to be written, but this time with the goal of having it ingested by LLMs.

[AceyMan]

for those who didn't know what is RAG offhand (like me), https://research.ibm.com/blog/retrieval-augmented-generation...

[tester457]

Those are my first thoughts too. The calcification is real.

[ideamotor]

Yup