[coder543]

> (weights haven't been released, though)

Phi-1, Phi-1.5, and Phi-2 have all had their weights released, and those weights are available under the MIT License.

Hopefully Microsoft will continue that trend with Phi-3.

> outputs 1212 tokens/sec on iOS

I think you meant "12 tokens/sec", which is still nice, just a little less exciting than a kilotoken/sec.

[jph00]

Weights will be realised tomorrow, according to one of the tech report authors on Twitter.

[ignoramous]

> you meant 12 tokens/sec

Thanks! The HTML version on archive.is has messed up markup and shows 1212 instead: https://archive.is/Ndox6

[intellectronica]

Weights are coming tomorrow.

[homarp]

tomorrow is now: https://huggingface.co/microsoft/Phi-3-mini-4k-instruct