[m3kw9]

It won’t work because will need as much training data as ChatGPT to get to its general knowledge level.

A subset will give you a subset of the knowledge, it’s no free lunch

[nullc]

The post is referring to fine tuning. You can train your model on the internet, but then it will just produce internet content and not behave subserviently (or carrying the operators desired polical biases rather than random internet ones). Models like ChatGPT take an internet trained model and then perform additional training to make it less internet-like and more cooperative.

Some recent research hash showed reasonable success transferring fine tuning between models using outputs.