[pddpro]

Imagine a crowd sourced metadataset of which model output is "good". What happens when we try to incorporate that knowledge into the pre-existing model? Will it learn to generate more "good"looking output?

[jayalammar]

Yes. This is already done in research and commercially (https://openai.com/blog/instruction-following/).