Hacker News new | ask | show | jobs
by jgalt212 596 days ago
At what database size does it make sense to move from SQLite to DuckDB? My use case is off-line data analysis, not query / response web app.
1 comments

It's not so much about size but about usage pattern.

If your workloads require fast writes and reads, SQLite will probably work fine.

If you're looking to run analytic, columnar queries (which tend to involve a lot of aggregation and joins on a few columns (say less than 50) at a time), then DuckDB is way more optimized.

Oversimplifying, Sqlite is more OLTP and DuckDB is more OLAP.

Probably also worth mentioning that DuckDB can interact with SQLite dbs.

https://duckdb.org/docs/extensions/sqlite.html https://duckdb.org/docs/guides/database_integration/sqlite.h...

Thus potentially making duckdb an HTAP-like option.