Hacker News new | ask | show | jobs
by mzitelli 1168 days ago
Glad you liked it! Currently, context size is an issue. The user must clear the conversation when the context limit is reached. Knowing that I added basic memory access commands so GPT-4 may store some context between sessions. To reduce the context usage I also defined a system prompt that incentivizes selecting code ranges, not entire files. With this, GPT-4 is able to solve medium-complexity tasks, including implementing commands in this extension itself. For the future I expect GPT-4 with 32k tokens will greatly improve this extension capabilities. Also, I am looking into LangChain to reduce conversation length, define goals and employ a better memory solution.