[danielbln]

It doesn't, but semantic search is a lot less relevant if you can squeeze 350 pages of text into the context.

[quinncom]

OpenAI charges for all those input tokens. If an app requires squeezing 350 pages of content in every request is going to cost more. Vector DB still relevant for cost and speed.

[gk1]

Besides the cost factor, stuffing the context window can actually make the results worse. https://www.pinecone.io/blog/why-use-retrieval-instead-of-la...