Elastalert + Kibana + Slack is great if you use logstash/streamstash to aggregate logs internally. I also combine new relic and slack for incident management.
Never heard of Elastalert, I'll have to check that out. By the name I'm guessing it's triggers off an elasticsearch server, which would cover infrastructure I already have - so that's nice.
Thanks for the suggestion!