[conception]

https://cognition.com/frontiercode

Quality vs cost - medium is the sweet (perhaps better too!) spot.

[fastball]

That is just a single benchmark tho

[dhorthy]

my issue with frontier code is that it uses a model judge for quality whereas slop code bench forces a model to grapple with its own garbage code in order to receive a functionality reward