Hacker News new | ask | show | jobs
by iknownthing 748 days ago
Are you paying for the API calls yourself here?
2 comments
maxkrieger 748 days ago
I have a lot of OpenAI API credits to use by end of the month, so I’m using 4o. I’ll probably switch to a more sustainable model afterwards, consider this a request for API credits, all! Email’s on website :)
link
Falimonda 748 days ago
It seems like they're caching information/replies on key words which is a good optimization.
link
iknownthing 748 days ago
I assumed it was coming straight from the API because of the token-by-token generation effect but maybe you're right.
link
rodiger 748 days ago
The token-by-token responses are probably API, while the "instant" loads seem to be cached.

Probably using groq based on speed of response

link