Hacker News new | ask | show | jobs
by anonzzzies 781 days ago
Groq with llama3 70b is so fast and good enough for what we do (source code stuff) that it’s really quite painful to work with most others now. We replaced most our internal integrations with this and everything is great so far. I guess they will be bought soon?
2 comments

How is that possible with Groq rate limits?

Fireworks has Llama 3 for the same effective speed with much more realistic rate limits (and billing)

Groq relaxes the rate limits if you work 'closer' with them.
how do you work closer? we filled out the enterprise form and I DMd a mod in the Discord..
What do you guys do?