Hacker News new | ask | show | jobs
Llama2 on Replicate faster than ChatGPT? (github.com)
1 points by ij23 1040 days ago
2 comments
ij23 1040 days ago
Ran some testing and discovered llama2 on replicate is faster than chatgpt!

Code - https://github.com/BerriAI/litellm/blob/main/cookbook/Evalua...

Are others seeing similar results?

link
agnokapathetic 1040 days ago
The response time you get from a Pay-as-you-Go account on OpenAI is not anything close to what you get with an Enterprise Agreement. If your usage is large enough, talk to your account rep.
link