Hacker News new | ask | show | jobs
by gnufx 2442 days ago
I know how data collection works, but it sounded as if 25GB/s was regarded as high compared with filesystems you can buy.

Obviously some people do want GPFS, if they can afford it, but Cori uses Lustre. I don't mean to claim that either is ideal for streaming high rate event data, of course.

2 comments

> Obviously some people do want GPFS, if they can afford it, but Cori uses Lustre

Data model at CERN does not match the one of a supercomputer. CERN data are not processed locally but distributed and spread to ~100 of participating institute in the experiment.

Moreover, "personal opinion", GPFS is crap. It's an old relic from the 90s that has so many quirk and problem of design that it would deserves an entire conference on it. Plus the fact it's proprietary and expensive.

The only reason that make GPFS still alive is that for a long time, the only alternative was Lustre, and Lustre is even worst.

lustre is crap.

Every single supercomputer meeting I've been to (I've been part of the community for years, they often invite me to their meetings to give an industry perspective), people are just continuously complaining about the filesystems, and it's GPFS and Lustre at the top of the list.

What filesystems would they like to be using?