[iamnotagenius]

With all due respect to Deepseek, I would take their numbers with grain of salt, as they might as well be politically motivated.

[jarym]

Any more politically motivated than a model from anywhere else?

[pama]

The current version of sglang allows inference with the R1 model at a cost that is very close to the rate that DeekSeep claimed (using H100s, not exactly the DeepSeek compute). Their claim is almost validated by replication at this point so there is nothing left to take with a grain of salt other than the possibility that there exists potentially an even higher margin than what they claimed if one were to optimize for modern NVidia hardware.

[WithinReason]

is that better or worse than commercially motivated?

[leeoniya]

commercial motivatation needs to show eventual profit to be sustainable, while political does not.

though at the outset (pre-profit / private) it's hard to say there's much difference.

[bee_rider]

> though at the outset (pre-profit / private) it's hard to say there's much difference.

I think this is the tough part, we’re at the outset still.

Also, a political investment could could be sustainable, in the sense that China might decide they are fine running Deepseek at a loss indefinitely, if that’s what’s going on (hypothetically. Actually I have never seen any evidence to suggest Deepseek is subsidized, although I haven’t gone looking).

[lazide]

Also, solar panel dumping as a quite successful example (on many, many fronts).