Hacker News new | ask | show | jobs
by MuffinFlavored 1203 days ago
> Doing this for user specified Python environments

Who is using this/asking for this/why?

1 comments

dagster.io is an open source Python library for building data pipelines. When using Dagster your project may depend on other Python data analysis and warehouse libraries like pandas, snowflake, pyspark and so on. Each org's requirements for their data orchestration will be different. When executing the pipelines in Dagster Cloud, we need to replicate their Python environment.