Hacker News new | ask | show | jobs
by petesergeant 581 days ago
> What other chunking strategies would be useful for RAG applications?

I’m using o1-preview for chunking, creating summary subdocuments.

1 comments

That's pretty cool! I believe a research paper called LumberChunker recently evaluated that to be pretty decent as well.

Thanks for responding, I'll try to make it easier to use something like that in Chonkie in the future!

Ah, that's an interesting paper, and a slightly different approach to what I'm doing, but possibly a superior one. Thanks!