Hacker News new | ask | show | jobs
by sethjr5rtfgh 1422 days ago
Could you clarify what "keep track of state of assets" means?
2 comments

https://www.dagster.io/blog/software-defined-assets

Of course, nothing stops Airflow or other tools fron thinking this way as well.

It's a mindset shift to a more declarative model. The idea has also popped up in other niche orchestrators.

This is an oversimplification but IMO the easiest way of picturing it is instead thinking of defining your graph as a forward moving thing w/ the orchestrator telling things they can be run you shift to defining your graph nodes to know their dependencies and they let the orchestrator know when they're runnable.