[q_andrew]

It seems like these types of tools will quickly proliferate any kind of meaningful AI tooling, which makes more sense to me than the idea of getting the best result from a single offhanded request. I haven't used GPT a lot, but from my experience, a response or prompt from earlier in the conversation can taint the rest of the output since the LLM will try to keep a consistent tone.

[kordlessagain]

Yes, which is why it’s important to track signals for the questions/asks and answers.

Also, the document collection and strategy for prompt building is likely more important than the UI or framework.

I’ve been working on a project that uses keyterm extraction for building smarter prompts for document exploration, without any opinionated frameworks: https://github.com/featurebasedb/DocGPT