[zix]

Honest benchmarks. Open and gracious group of developers behind it. Disclaimer - I'm married to one of these guys. I'm not a programmer, but I can see how hard this group has worked to provide something useful to the community and I've enjoyed watching it grow.

[chromatic]

Honest benchmarks.

"Select random number from MySQL"? I'd like to see the stochastic control for that one.

[bhauer]

We have considered alternatives [1] but randomly selecting from 10,000 rows was selected because it's easy to implement in a threadsafe manner without introducing even more complicated requirements such as a concurrent queue or atomic counter.

Note that after the warm-up, MySQL is essentially guaranteed to have the entire table in its own cache, so the exercise is testing the ORM (if applicable), database connection pool, and the database driver.

Honestly, assuming none of the implementations are using an expensive random number generator (e.g., a random number generator intended for cryptographic use), I don't believe there would be different results if it were feasible to sequentially retrieve rows without the need to contend with concurrency.

[1] https://github.com/TechEmpower/FrameworkBenchmarks/issues/11...

[pekk]

I'm sure they're great guys, but I found it interesting how many obvious suggested changes were not incorporated at all. What's honest about it?

[bhauer]

Pekk, we'd love to address any problems you can point us to. Obviously we have limited time to work on this, so the best way to get a fix in is via a pull request. Are there any issues in particular you think are especially high-priority?

[gphreak]

They have been extremely responsive to feedback so far and always carefully explained why they are not incorporating everything the community suggested.

[wereHamster]

Open a pull request.