Hacker News new | ask | show | jobs
by stevofolife 1272 days ago
I might be super naive here but can someone explain how this type of thing works? Behind the scene, is the bot hitting the OpenAI APIs?
3 comments

Yup! Behind the scenes I send AIOHTTP requests to the various OpenAI endpoints.
If you check out models/openai_model.py, you'll see it's using text-curie-001, among others, which is an OpenAI dataset. This model is imported in main.py under the name 'Model', which makes me believes the openAI API is serving as the main model used for inference
So I actually have it set to use both the text-davinci-003 and text-curie-001 models. If you’re on low usage mode, that’s when the curie model will be used :)