Hacker News new | ask | show | jobs
by TechBro8615 1046 days ago
> because they trained with data derived from chatGPT

Can you expand on this (genuinely curious)? Did Facebook use ChatGPT during the fine-tuning process for llama, or are you referring to independent developers doing their own fine-tuning of the models?

2 comments

The community fine tunes. I doubt Facebook used chatgpt.
Yes, much of the dataset was simply copied and pasted from the inputs/outputs of other chatbots.
Incredibly bad practice lol
Not really, it's a whole field (model stealing).