[phorkyas82]

Don't forget that gcc is in the training set.

That's what always puts me off: when AI replaces artists, SO and FOSS projects, it can only feed into itself and deteriorate..

[kuboble]

The AlphaZero approach shows otherwise, as long as there is an automated way to generate new test cases and evaluate the outcomes.

We can't do it for all domains, but I believe we can for efficient code.

today's models could be probably already good enough to compose tasks, and evaluate the results.

[FeepingCreature]

it can feed into itself and improve. the idea that self-training necessarily causes deterioration is fanfic. remember that they spend massive amounts of compute on rl.