|
|
|
|
|
|
by AdamProut
1027 days ago
|
|
|
Its a popular design for SQL Data warehouses. I think almost all of them (snowflake, redshift, etc.) store cold data in S3 and hot data on local disk[1][2]. It works well if the data is stored as immutable files (i.e., A log structure merge tree) or is not index at all (classical columnstores). S3 doesn't provide an efficient way to update a file. [1] https://dl.acm.org/doi/10.1145/2882903.2903741 (snowflake SIGMOD paper)
[2] https://dl.acm.org/doi/10.1145/3514221.3526055 (singlestore SIGMOD paper) |
|
|