[yuhongsun]

We use LlamaIndex very sparingly. Specifically the context aware document chunking functionality is via LlamaIndex.

We couldn't use the more involved pipelines because we needed significant custom logic to enforce permissions, filters (like time filter, source filter, document-set filters), and other complexities. At that point, it's easier to write from scratch rather than conform to expectations of these third party libraries.

[tibanne]

I was considering starting a project just like this using Llamaindex but I think I'll give yours a try first before going that route. Looks good. Thank you.

[yuhongsun]

I think these developer platforms like LlamaIndex and Langchain are super great for prototyping and understanding the crowdsourced best approaches in solving these new LLM related challenges.

Depending on how custom the pipelines need to be, you'll either find that you've saved a huge amount of time using these libraries, or you'll find that you have no option but to switch off and build from scratch.

[tibanne]

That makes sense. It was my fear that I'd start with a wrapper that helps but end with a wrapper that hurts. Good to know that it's still worth experimenting with these for prototyping and discovery. I'm guessing that there will still be components of them that you can use in a product if you don't want to implement something quite specific yourself.