|
|
|
|
|
by markerz
292 days ago
|
|
Why would you use sentence level chunking? I’ve generated embedding for “objects” or whole documents to get similarity scores. Helps with “relevant articles” type features. I’ve also made embeddings for paragraphs or fixed sized chunks for RAG lookups. Good for semantic search. I don’t understand why you would want embeddings on sentences. > Chunking Strategies > Sentence-level chunking works well for most use cases, especially when the document structure is unclear or inconsistent. |
|