Hacker News new | ask | show | jobs
by dbcfd 3887 days ago
Although D may have a fast json parser, this benchmark is a horrible comparison. Really need a better way to do cross language comparisons.
2 comments

The repo owner is accepting pull requests for the benchmarks so at least it's fixable.
It's a lot of work to fix this benchmark, which is fairly contrived to begin with. To start, have to adjust every sample to accept a warmup time, then run time (which is likely multiple samples), measuring results in that run time, both speed and performance. And you also have to be careful that the compiler is then not optimizing out the repetitions in the runtime, while still allowing optimizations that would produce the best performance.
If I had a nickel for every time I've seen a language benchmark be a very specialized contrived problem (in this case specific JSON with specific access pattern) I'd have a lot of nickels.