Hacker News new | ask | show | jobs
by revision17 1358 days ago
DuckDB is awesome! I find it the easiest way to ingest data from various sources then query it into a form I can do analytics on.

The datasets I work on are a bit too big for pandas, but spark is way overkill for them. DuckDB lets me efficiently work on them using only a single computer.

1 comments

DuckDB doesn’t also need to load datasets into memory like pandas? I guess it depends what you’re doing to the data.