Hacker News new | ask | show | jobs
by npalmer 2660 days ago
Have a look at Elasticsearch. https://www.elastic.co/products/elasticsearch

Disclaimer: I work for Elastic.

2 comments

Elastic rocks! I've been using it for a new project and am really digging it.

You guys should build in some better profiling tools for logstash. I'd love to be able to see how much time each filter rule took to know where to spend my time optimizing. Since its all in a java virtual machine its tough to see things like how many threads are working hard vs idle and how much memory each is using etc.

We do pull out a lot of metrics as well as how well your Logstash pipelines are performing.

Feel free to drop me an email (in my bio) I’d love to help if I can!

Just stumbled upon this: https://www.elastic.co/blog/monitoring-logstash-filters. It may be exactly what I was looking for.
A great product and still evolving! :) It is crazy how powerful it becomes with Kibana, but you still have the option for DIY graphics and integrations!