[tiagopavan]

Since the release of the gpt-3.5-turbo model by OpenAI, I have been wondering how companies are dealing with the token limit to gather insights from a large corpus of text without having to retrain the model.

To understand how it works, I created an open-source Jupyter notebook that creates a chatbot using vector embeddings (which is the workaround for the token limitation!). The chatbot connects Zendesk's knowledge base to ChatGPT, which can answer natural language questions using only the appropriate context.

I hope this can be helpful to anyone who is playing around with AI models in general :)