Y
Hacker News
new
|
ask
|
show
|
jobs
by
ploppyploppy
1206 days ago
What project?
Do you mean polars reading Parquet into DuckDB to process that amount of data?
1 comments
jmartin2683
1199 days ago
Internal. We're using Polars as the query engine to effectively query that data statically at rest (more accurately, mmap'd on disk in arrow ipc format)
link