Hacker News new | ask | show | jobs
by sherifnada 1863 days ago
It's a module which extracts data from a source (an API, database, etc..) or pushes data to a destination (warehouse, blob storage, API, etc..). They're ubiquitous in data engineering & analytics workflows where users often need to consolidate their data in one database or warehouse to build dashboards, run analyses, etc..
1 comments

I already responded to a different comment in this thread, but you seem to be knowledgable on the subject. Is this a tool to assist with ETL's between otherwise incompatible sources/destinations?
Indeed! You could use the CDK to build the data integration pipelines that your ETL solution doesn't support.

Airbyte comes also with ~70 connectors. So if we already support the destination you want, you can only build the source connector that we might not support as well. Our goal is support 200 connectors by the end of the year and address the long tail of integrations in 2022 :).