Hacker News new | ask | show | jobs
by dkhenry 4205 days ago
Sounds like a great platform. I wonder how many instances of everything they need for peak time. I have a system that is rated for 5M Time series data points per second and it takes about 150 physical servers so I am curious about what a Netflix sized ( 20M time series data points per second ) would look like.
2 comments

"It's complicated."

As the announcement notes, we have multiple tiers holding different data horizons. The most active, and large, tier is the one holding the last six hours of data. That tier, being the most critical one (we try to train our engineers to only need 6 hours of data to understand how their system is working in the worst case), is mirrored. Right now, each of those mirrors is about[0] 756 r3.2xl instances.

[0] For a very exact definition of "about," though that exact number could change in the next 5 minutes, or 5 hours, or 5 days, or not until we see another metrics increase.

In the video they say that they're close to 1B/min. http://youtu.be/tHrT6kQR7vw?t=36m
Pshaw. That was last year :)

(The presenter in the video)

They list a peak of 1.2 billion / minute which is 20M/ second