Hacker News new | ask | show | jobs
by cvick 3673 days ago
There is nothing in that method that accounts for the possibility that the test may be flawed in some way. I suppose that the assumption here is that the test is 'perfect' in that each question is worded in such a way that there is one and only one 'right' answer. But, as a taker of this kind of true/false test, if I am only allowed to provide my assessment of my own confidence in my answer without an explanation of "why" I assigned that value, then there's no way to answer in a way that I will not be penalized for a question that I don't feel that I can answer as asked.

Consider assigning an additional value of '1' to each question initially as a representation of the author's confidence that the question is not flawed in any way. Then, if a significant segment of the test taking population indicates that they believe that the question is flawed in some way, then, the "author's confidence" for that question would be reduced by an amount that wouldn't penalize me for identifying that flaw while still allowing for less 'partial credit' to those who answer incorrectly without being aware of the flaw, or more specifically, not giving as much credit to those who answered 'correctly' in spite of the flaw.

It's also possible that the question I think is a 'flaw' is really a 'trick' question and that in order to answer 'correctly' you must discover the trick -- this would still allow for a better result in that it more accurately assesses whether I really understand the question or not.

It also occurs to me that if the test administrator wants to give a test where they can assign some manner of partial credit to an answer, then they shouldn't give a true/false test in the first place.