[otabdeveloper4]

There won't ever be newer training data.

The OG data came from sites like Stackoverflow. These sites will stop existing once LLMs become better and easier to use. Game over.

[esclerofilo]

Every time claude code runs tests or builds after a change, it's collecting training data.

[otabdeveloper4]

You need human language programming-related questions to train on too, not just the code.

[8note]

thats what the related chats are for?

[otabdeveloper4]

And now you're training LLMs on LLM output.

No, you need something like Stackoverflow. The crowdsourced ratings system that Stackoverflow has (had?) is the crucial part.