Very cool! Have you considered local LLMs for a free/lite tier?
I do agree that 3rd party LLM services (e.g. OpenAI) are much more powerful. For basic tasks (e.g. summarization, Q&A), local LLMs seem to perform decently.
We have considered it, though most of our users use Zenfetch for things like
1. Research across an industry
2. Generating new content
3. Connecting ideas / building networked thought
For that reason we were deterred from using local models. Hopefully the Mistral team and similar keep pushing out new developments to get comparable with GPT-4 levels
1. Research across an industry 2. Generating new content 3. Connecting ideas / building networked thought
For that reason we were deterred from using local models. Hopefully the Mistral team and similar keep pushing out new developments to get comparable with GPT-4 levels