Hacker News new | ask | show | jobs
by jodrellblank 1258 days ago
And what are you going to do when you need a human to read sixteen trillion bytes of compressed logs streamed off a single SATA disk?

Once you face the fact that the performance of a single SATA disk means you can't search the logs in any quick time, and nobody can possibly read that much log data, so nobody will use it, you start to see it as a hoarding disorder not a useful tool.

1 comments

It's not unheard of to need to retain years even decades worth of logs due to regulatory compliance. Nobody is reading them, they just need to exist. In that scenario you'll probably keep the current year or so fresh on a mechanical drive and past years on tape.