[abtinf]

The lack of a token rate metric for the kimi example is disappointing.

[zozbot234]

The latter link says they get ~1.7 tok/s which is quite impressive for a near-SOTA local model running on ordinary hardware.