[dtjon]

We ditched Spark Structured Streaming for Flink for a Kafka consumer, processing 3B events per day. Its been extremely stable so far, and half the cost of the spark cluster

[SureshG]

Could provide more details about your cluster setup? How big is your cluster?