|
|
|
|
|
by arpinum
65 days ago
|
|
Latency, predicate pushdown. Pre-compaction the recent data can be in small files, and the delete markers will also be in small files. This will bring down fetch times, while ducklake may have many of the larger blocks in memory or disk cache already. Reading block headers for filtering is lots of small ranges, this could speed it up by 10x. |
|
Would be really useful pre-compaction and to deal with small files issue without latency penalties