Hacker News new | ask | show | jobs
by easton_s 1627 days ago
10 years of operation, but hundreds of years of data to analyze. We are still analyzing data captured from terrestrial telescopes that haven't operated in decades.
1 comments

Is that due to the format or availability of the data?
The sheer amount of data. The black hole that was imaged recently alone was four petabytes of data

https://www.hpcwire.com/2019/06/24/a-behind-the-scenes-look-...

Are there any interesting private companies / startups in this space?
No idea, but if it's difficult for acedemia to get hold of this then how could startups? More to the point, what would be the value add to make the commercials viable? Interested to hear if you think there could be?

Perhaps there's some altrusitic archive.org style site that needs to exist for science, that features datasets of multiple PB in magnitude and allows anyone to pull the full archive.

Maybe in the future, but still, people still have access to source imagery and they regularly make spectacular images and material from public domain data from space agencies and interest groups. You don't need 4PB unless doing something like, well, imaging a black hole.

It's fun, not sure how much there is run a business from it, unless you plan on taking the data and creating spectrographs for some future mining mission way in the future? :D