[porphyra]

Try asking in the groq discord [0]. Some groq employees are fairly responsive there.

For groqcloud the rate limits are fairly clear [1]. For example, for llama3-8b-8192 you get 30 requests per minute, 14400 per day, and 30000 tokens per minute. That said, it's the beta free tier so it sometimes goes down randomly and the limits may be different once they start charging for it.

I'm not affiliated with groq but I use groqcloud to make some simple chatbots since it's currently free.

[0] https://discord.com/invite/n8KtCjfAug

[1] https://console.groq.com/settings/limits