[scrollaway]

How is this useful or insightful?

You ever go to forums full of entomology specialists and tell them you don’t understand their fancy terms?

[dan_gee]

My point is that the differences between these models are so minor that obsessively benchmarking them comes across as navel-gazing.

[joatmon-snoo]

The evidence that proves a model is actually a step function change is these benchmarks.

If a model isn’t a step function change? Welcome to research.

[Johnny_Bonk]

like all good science, measure everything