|
|
|
|
|
|
by simonw
464 days ago
|
|
|
On way to think about it is SQLite for columnar / analytical data. It works great against local files, but my favorite DuckDB feature is that it can run queries against remote Parquet files, fetching just the ranges of bytes it needs to answer the query using HTTP range queries. This means you can run eg a count(*) against a 15GB parquet file from your laptop and only fetch a few hundred KBs of data (if that). |
|
|