|
|
|
|
|
by seg_lol
2052 days ago
|
|
Ok, I didn't realize that Arrow was in-memory and not also on-disk. As serializing between the two didn't make sense to me. I would have thought that Arrow would also be an on-disk format (mmap'd) so that there would be little to no conversion losses. Why convert to an on-disk format (Parquet) and not save the in-memory representation to storage directly? |
|