[bxh]

The line about how the engineers view the tests as an optimization problem really resonates with me. When the results of tests administered in an artificial setting becomes the primary method of assessment, such a trend will inevitably emerge.

Take school examinations for example, in highly competitive environments where test scores alone are the major determining factor, students begin to consider the benefits of forgoing comprehension of the material for rote learning.

[bijection]

These are both good examples of Goodheart's law — "When a measure becomes a target, it ceases to be a good measure."[1]

https://en.wikipedia.org/wiki/Goodhart%27s_law

[csours]

Thanks for that, I remembered that this was a "law", but I never remember the name, and whenever I try to tell anyone I get it wrong or express it in a confused manner.

[csours]

What gets measured gets ...

* Managed [1]

* Done

* Gamed

* "Optimized"

* Cheated

Especially if there are rewards associated with the measurement.

1. http://www.druckerinstitute.com/2013/07/measurement-myopia/