[potatoman22]

I wonder how much of the performance gains can be attributed to their improved dataset rather than their architecture. That would be an expensive experiment.

[hack_ml]

The ablation studies and the dataset can be found here: https://www.zyphra.com/post/building-zyda-2