Hacker News new | ask | show | jobs
by rw 3537 days ago
The world is bigger than web companies.

For contrast, one experiment at CERN produces 40TB/sec of sensor data, before downsampling and filtering: https://en.wikipedia.org/wiki/Compact_Muon_Solenoid#Collecti...

2 comments

Holy crap. And yes, it definitely is; if you haven't looked up Industry 4.0 or Industrial Internet, that entire sector is making a push to sensorize.

As a rearguard defense: Yes, but, what percent of the time is CERN running an experiment [that generates that data]?

According to a quick Google search, average time spent driving is 101 minutes / day.

Totally makes sense that CERN (and, likely, any large Science! efforts) produces that level of burst data, but wouldn't these cars produce more data over time?

As a different topic, a different friend of mine is of the opinion that AI is dependent on the throughput of data through the system; think about the amount of information your body feeds to your brain, and how much time it was doing that before you were capable of communication.

Similarly, I've worked on robotics platforms where we had to down sample incoming sensor data, otherwise the perception algorithms (which are very statistical) wouldn't be able to spin fast enough.