[forgetbook]

Or, this is why evaluation other than rote testing matters.

In specific situations, professional testing is relevant. The Bar, the USMLE, etc. In many more situations, quality is driven by accomplishing goals and solving problems that are by definition nonstandard.

Every practicing physician and lawyer passed their professional exam, yet, some remain more effective than others. Standardized testing is a high-pass filter. You can enforce a minimum, but cannot evaluate maxima. In this situation, a whole class did bad on an exam they all took, and there is still no way to infer whether it was the students, the instruction, or both. Lots of energy spent, very little effective training and credentialing accomplished.