Hacker News new | ask | show | jobs
by DSJayatillake 1374 days ago
I don't really think that either will overtake Airflow in terms of sheer number or users or orgs it is deployed at.

1. Dagster and Prefect won't ever have a hosted version on AWS/GCP (teams can spin these up from their consoles without even considering a vendor conversation or leaving their infra).

2. There are very large Airflow projects out there with huge DE teams running them, that just can't really move to Dagster or Prefect very easily. Not do they really want to if they can do what they need to in a tool they are familiar with.

My perspectives have been very much coming at the tools with fresh eyes.

Will they overtake Airflow in terms of features? They probably already have.

1 comments

Dagster already offers Dagster Cloud which came out a month or so ago[1]. It's a fully hosted solution for teams that don't want to run their own.

[1] https://dagster.io/cloud