[yogthos]

The real question is whether it's easier to improve the software side instead. There are likely a lot more optimizations possible in terms of model architecture, and if there is a compute bottleneck, then it's going to put a lot of pressure on Chinese labs to address the problem using more efficient designs.

[tedd4u]

And one cool trick is that if one develops step function more efficient training, one can still “open source” the model without revealing the training techniques.

[yogthos]

exactly