[ithkuil]

Intent matters I guess.

Did they accidentally train on that public piece of info they scraped anyway because they are scraping the whole web?

Or did they intentionally scrape chatgpt output to see if that would help?

[b112]

They could have trained, then modified code, repeat, to better enhance training in the current version.

Then after, train on raw data.