Hacker News new | ask | show | jobs
by esafak 374 days ago
For bigger workflows, this declarative pattern is already implemented by orchestrators like Dagster, Flyte, and recently Airflow; e.g., https://dagster.io/blog/declarative-scheduling [fixed]
2 comments

Are you talking about Airflow Datasets and data-aware scheduling?

https://airflow.apache.org/docs/apache-airflow/2.4.0/release...

Isn't that about as recently as Dagster?

Yes, asset-aware scheduling.
this 404's for me