[davedx]

Cost is one aspect, but what about ingest time? You’re adding significant processing time to your pipeline with this method right?

[simonw]

I expect most implementations of RAG don't mind this too much - if you're dealing with only a few hundred more pages of documents a day the ingestion time from using fancy tricks like this is going to be measured in minutes.