[xigoi]

How would you objectively perform such benchmarks?

[sedatk]

Live competition. Benchmarks would just be metrics recorded during the live broadcast, not goals. You can later aggregate those metrics to come up with accurate benchmarks about many scenarios about software development. Think of NBA but for programming.

[xigoi]

Not a bad idea, but I feel like it would favor popular languages because they're more likely to have users who are really good at fast programming.

[sedatk]

True, but people good at fast programming would seek better alternatives to get ahead of the competition.