[hyperknot]

I got 700+ tokens/sec on o3 after the announcement, I suspect it's very much a quantized version.

https://x.com/hyperknot/status/1932476190608036243

[dist-epoch]

Or maybe they just brought online much faster much cheaper hardware.

[az226]

Or they are using a speedy add-on decoder.

[beering]

Do you also have numbers on intelligence before and after?

[zackangelo]

Is that input tokens or output tokens/s?