Hacker News new | ask | show | jobs
by kshri24 25 days ago
> streams WAL changes straight into Apache Iceberg on S3, queryable from psql via an embedded DuckDB

Why not use Ducklake instead of Apache Iceberg? Wouldn't that simplify the architecture substantially?
1 comments
vira28 22 days ago
From what I understand Ducklake needs a dedicated metadata database and it also ties to DuckDB land wherease with Iceberg many engines can query directly.
link
kshri24 22 days ago
You are already using Postgres in your setup so why not just use Postgres itself as metadata database? It is a much better setup than using Iceberg [1].

> and it also ties to DuckDB land wherease with Iceberg many engines can query directly.

Ducklake can also be queried by many engines [2]. Though not as exhaustive as Iceberg.

[1]: https://www.youtube.com/watch?v=-PYLFx3FRfQ [2]: https://ducklake.select/docs/stable/#list-of-ducklake-client...

link