Hacker News new | ask | show | jobs
by rdedev 52 days ago
Not totally wrong. Self play works well with if your problem can be easily simulated in an RL environment where the model can easily explore different states. RLHF or similar techniques is not that since we don't have exactly have a simulation environment for language modelling

Right now there are companies which hire software devs or data scientists to just solve a bunch of random problems so that they can generate training data for an LLM model. Why would they be in business if self play can work out so well?
2 comments
notpachet 52 days ago
> Right now there are companies which hire software devs or data scientists to just solve a bunch of random problems so that they can generate training data for an LLM model.

Sounds like Macrodata Refinement.

link
vidarh 52 days ago
> Why would they be in business if self play can work out so well?

Because it is still cheaper.

link