| I'm using AnythingLLM for this now.
https://anythingllm.com/ MIT License on GitHub This week it got the X.ai API added which is what I'm using. Grok is not as good as Claude or ChatGPT yet, but don't bet against Elon. https://x.com/ServeTheHome/status/1850917031421399543 https://x.com/elonmusk/status/1830650370336473253 It's the desktop solution I've been looking for.
If you have a heap of prompts, you can create a Workspace for each. Super easy. Here's my prompts if anyone is interested: https://github.com/grantcarthew/notes/tree/main/Prompts I only have two minor complaints with AnythingLLM:
1. No light mode (why does everyone want dark mode, it sucks for anyone older than 30)
2. It's electron Edit: replaced cluster link with source (I think) |
A few outstanding features:
- Fast: Import ChatGPT history, loads thousands of conversations at once.
- Floating Chat: spotlight / ChatGPT desktop app like floating window.
- Customization: You can add any OpenAI compatible API (including X.ai) as a model, and just edit the url/model id
- Chat with files: Not as complete as complete as a RAG solution for now, but we feature simplicity. Basically you can drag and drop PDF files onto a session or add files/folders to a model (like custom GPT) to start chatting.
- And, yes we support light mode! And several light mode code themes as well