[c7b]

Yeah, but with the breakneck speed at which this field is moving, how long will it be before we have dedicated 'Coding Competition' models (if they don't exist already somewhere)?

I can't help but reminded of AlphaGo. When Lee Sedol saw the footage of the AI beating the then European champion, he was like 'That's neat, but it would still take a decade of training to get to world champion level'. That was about half a year before he crushingly lost to it. We just underestimate how fast those models can evolve. I know that playing a well-defined game against itself is an ideal setting for RL models, and that language models use very different architectures. Nonetheless, I still think it's reasonable to think that coding competitions may soon go the way of chess,..., where humans stand no chance against the best machines.

Not that that's a reason to cancel them immediately like Google just did (after all, chess is arguably thriving), but that's a different story.