Hacker News new | ask | show | jobs
by partdavid 595 days ago
How does this replicate Postgres data? I glanced at the code and saw that it exports to a CSV file then writes out an Iceberg table for an initial snapshot--does it use Postgres logical replication?
1 comments

Full table re-syncing is our initial solution. Using Postgres logical replication is next on our roadmap!
So if we have a very large table, it means each time I replicate (how often does that happen?) it needs to rewrite the entire table and upload it to S3, right?