[aliljet]

The benchmarks here are confusing at best. Am I reading correctly that this model is essentially as good or better than all frontier models right now?

[anana_]

I believe the benchmark listed is about simulating the environment for the various tasks, rather than doing them. It seems that the point of this model is to generate sim data to improve other models with

[blourvim]

Benchmarks in general are a little iffy, the whole industry is going off of vibes anyways. Can't decide before trying it out