|
|
|
|
|
by ozgrakkurt
198 days ago
|
|
Makes sense. For rle and dictionary encodings I probably won’t use the 1024 block size to split the input. 1024 for block size is just for being able to vectorize delta encoding and bit packing. I am using this library for compressing individual pages of columns in a file format so the page size will be determined there. I’m not using fastlanes to do in-memory compressed arrays like it is originally intended for. But I’ll export the fastlanes API in next version too, so someone can implement it themselves if needed |
|