|
|
|
|
|
|
by imcoconut
1987 days ago
|
|
|
No reason you cant still use airflow for the orchestration/depenendecy management/scheduling. And for the processing and storage - Pandas and sqlite. Also would highly highly recommend looking into kedro (which has airflow integration, or you could just run your pipelines with crontab) |
|
|