|
|
|
|
|
by linzhangrun
36 days ago
|
|
I saw videos of coding with Mimo-V2.5-Pro UltraSpeed, which is advertised at 1,000 tokens/s, which is very impressive.: https://www.bilibili.com/video/BV1fME16uEW7 If the time-to-first-token latency also greatly improved, this could be very useful for end-to-end in controls, like autonomous driving for example. |
|
It tends to cost more than DS since it doesn’t seem to have as many input cache hits.