Hacker News new | ask | show | jobs
by datadrivenangel 12 days ago
"Popular metadata catalog solutions are Hive Metastore, AWS Glue Data Catalog, and Unity Catalog from Databricks.

For query engine you can use, for example, Apache Spark, Trino, or Amazon Athena."

DuckDB is eating the query engines and catalogs. Really could use more coverage on how DuckDB is changing the data tools landscape.

2 comments

It is a POS. Try connect a read-only while another proc is connected, you cannot. Try have separate processes cooperate, db corrupts if open too close on heels of close. I hate ddb with the power of a thousand sharp wet farts. I bitched to my new boss and no sympathy, imagine the schadenfreude when a week later I heard the whole team move to postgres - the boss hit his own head on the thing.
Can you suggest any good resources for your statement? I know DuckDB is hyped, but didn’t know they’re eating engines and catalogs.