Hacker News new | ask | show | jobs
by eatonphil 1468 days ago
You can do this for small datasets and I built an app around exactly this use case [0].

As your data gets bigger (just over time even if individual days don't emit more data) you'll end up building out partitioning schemes yourself or you'll move to a system that does that for you like bigquery/snowflake/etc.

[0] https://github.com/multiprocessio/datastation