[tome]

We don't have an API in public availability yet but that's coming soon in the new year. We will be price competitive with OpenAI but much faster. Deploying Mixtral is work in progress so keep your eyes open for that too!

[visarga]

Also make a long context Mistral-7B that spits 1000T/s

[tome]

I'll do it if you promise to say "wow!" :D

[tome]

Here you go:

https://www.youtube.com/watch?v=9c078xKGwdU

It's 850 tokes per second, so you don't have to say "wow" yet!