Hacker News new | ask | show | jobs
by dingclancy 916 days ago
Bytedance will still have access to the same open internet as OpenAI had. But it does not have the weights and the parameters.

However by asking ChatGPT questions and recording their answers, you can use that to fine-tune the model they are creating. They can tell their own model to answer the way ChatGPT answered.

In short they are copying how ChatGPT would answer. and not finding out for themselves by creating their own Question and answer (or completion) datasets.

That is what RLHF is. But anyway, Chinese companies will be able to compete here, as this will be commoditized quickly and China is the king of creating and selling commodities.