[Kafka]

> Goldman Sachs alone stores more data than the entire web

Why would you believe that Goldman Sachs stores more data than can be reached by HTTP?! Only YouTube amounts to petabytes of data. http://beerpla.net/2008/08/14/how-to-find-out-the-number-of-...

[nikcub]

I completely disagree with his calculation, and GS were storing over 1PB 8 years ago when the web was 80-150TB

the point is that it is frikkin big - and most investment firms now scan the entire web for signals