Hacker News new | ask | show | jobs
by recov 2233 days ago
Can you expand? We just set this workflow up and it seems to be working fine.
1 comments

NiFi is meant for stream processing and Airflow for batch processing, if your NiFi triggers an Airflow DAG that means that your entire process is batch processing and you shouldn't use NiFi in the first place. If you still want to do stream processing then use Airflow sensors to "trigger" it.