Hacker News new | ask | show | jobs
by sdepablos 1973 days ago
Sounds kind of strange not having incremental replication, it would make no sense for an ETL tool. In fact the documentation for PostgreSQL [1] is somehow contradictory at it both states "Incremental sync (copying only the data that has changed) for this source is coming soon" but also "Feature: Incremental - Append Sync / Supported: Yes"

[1] https://docs.airbyte.io/integrations/sources/postgres

1 comments

(Airbyte engineer) Agreed. Thanks for notifying us about that. We fixed it. We started by supporting only full refresh at the very start, as it was easier to support more connectors, but have been ramping up incremental across all the sources for a month now. Incremental should be supported for all sources within a few weeks.