[hessdalenlight]

No I didn't it yet. I would be grateful if you could advise me such a benchmark.

[jaggirs]

Not sure, havent done so myself but I think you can use MTEB maybe. Or otherwise a llm benchmark on large inputs (and compare your chunking with naive chunking)