[leobg]

You’re right. They can actually do RLHF just using their users. Showing each of them slightly different generations and watching their behavior.