Hacker News new | ask | show | jobs
by dragontamer 2397 days ago
That's probably a good point: the Linux Kernel is written using the C language. But C++ is a far more complicated language to parse and compile.

Unreal Engine, Firefox, Chrome... large C++ programs easily take an hour to compile on normal hardware.

With that being said: compiling for an hour is a huge hassle for reviewers. I think reviewers prefer benchmarks that complete in under a minute, rather than over an hour.

2 comments

That's why I also use the LLVM compilation test (C++) and other workloads besides just the Linux kernel... But it seems the Linux kernel results are always what generates the most interest.
I would bet it's just familiarity. Most people that are interested in PCs have heard of Linux, and know that it has a Kernel. Or they even have already compiled kernels themselves. Whereas LLVM is more of a thing that is known to a subset of software developers.

I'm personally happy to see the LLVM tests, since it gives a good impression on what benefits software developer which work on big native code-bases can expect.

I think it's path dependence. The kernel has a large number of compile-time configuration options; back in the 90s, it was common to compile your own kernel, after tuning these options to your own particular hardware. It was also common to get new kernel releases (as a source code .tar.gz, or as a patch to the previous source code .tar.gz) directly from kernel.org, instead of waiting for the next release of the distribution you were using. So the time it took to compile a new version of the kernel for your machine was something many Linux users had experience with, and it was clear when a machine was faster (perhaps as a consequence of having previously compiled and installed a newer kernel!) because it took less time to compile the kernel. To turn that into a benchmark was just a matter of standardizing on a kernel release and a set of configuration options.
> With that being said: compiling for an hour is a huge hassle for reviewers.

Can't they just set it to run then go to lunch? Seems like a non-issue.

There's a lot of other tests that reviewers have to do, depending on their audience. Video editing (Adobe Premier), 3d Modeling (Blender), a few video games across genres (maybe an Adventure Game (Tomb Raider), a FPS like Overwatch, a strategy game like Total War, and a simulation game like City Skylines), and a few other workloads (audio, programmer, CAD, HPC, etc. etc.).

So there's that, but also the time to write these reviews. And finally, you're trying to out-compete everyone and release the review before everyone else so that your website gets more traffic.