|
|
|
|
|
by eatonphil
1468 days ago
|
|
You can do this for small datasets and I built an app around exactly this use case [0]. As your data gets bigger (just over time even if individual days don't emit more data) you'll end up building out partitioning schemes yourself or you'll move to a system that does that for you like bigquery/snowflake/etc. [0] https://github.com/multiprocessio/datastation |
|