Hacker News new | ask | show | jobs
by thesorrow 2385 days ago
Looks great ! I don't know If you use Apache Airflow in ML or ETL pipelines but I wonder if one could use nbdev to generate Airflow Dags/Operator. There's already some work done to execute Notebooks[0] but would be cool to convert them to Python code!

[0] https://airflow.apache.org/docs/stable/howto/operator/paperm...

1 comments

Oh interesting idea - not something I'd thought of. (We don't use Airflow at fast.ai so this will likely require a PR.)