[user5994461]

>>> why on earth do you have 10 billion log entries?

It's pretty low volume actually. A small company with < 100 developers and servers can generate a billion logs over a few weeks.

Normal logs from the system, syslog, applications, databases, web servers... nothing fancy really. It's common practice to centralize all these into ElasticSearch or Splunk.

Their scale of 10 billion logs 60 TB means they're a regular small to medium company.

[lawrjone]

You've nailed this!

This logging system was for all https://gocardless.com/ systems. We're a B2C company which means we have different economies of scale than many scale-ups of our size, but you were close with your guess:

Currently 450 people worldwide, ~150 in product development, of which ~100 fulltime developers.

[Kranar]

This seems suspect, that works out to approximately 25 log messages per developer per second assuming a 10 hour work day.

I work in a tightly regulated industry (finance), and even my company doesn't have a need to log 25 messages per second per person.

Is anyone else able to validate this claim that regular small companies log this much data?