|
|
|
|
|
by sleepybrett
478 days ago
|
|
I think we might be working at different scales a 40/month server with 8tb of disk would be a puddle on the floor in my current circumstances. The problem is that many if not most applications have their own log structure so just saying 'index it' doesn't cut it at all. |
|
I was talking about what it takes to search through a couple TB of logs. I said that with grep and Loki it's slow due to the linear search, and that indexing systems make it much faster (from many minutes to subsecond).
That's independent of whether you have more than just a couple TB of logs. If you have more, you just get more servers. You'll still get the subsecond results that I find so beneficial.