[yellow_lead]

Its impressive how fast this is. I don't use twitter anymore (for the same reason as your use case), but nice job!

[danielpetho]

yes groq is really amazing.

there is another player i've found when making this -> https://inference.cerebras.ai/

never tried their api tho

[wkat4242]

It's groq, they have amazing custom built hardware.