Hacker News new | ask | show | jobs
by DoctorOetker 2793 days ago
I am not correcting you, but simply illustrating how 85% accuracy tells us very little...

Let's make the spherical cow approximation that "a lie" is a fully defined concept, then we have 4 conditional (bayesian) probabilities:

P( "sincere" | sincere) The probability a sincere person is reported as "sincere".

P( "lying" | sincere) The probability a sincere person is reported as "lying".

P( "sincere" | lying) The probability a lying person is reported as "sincere".

P( "lying" | lying) The probability a lying person is reported as "lying".

The first 2 probabilities should sum to 1, and the latter 2 possibilities too, so we have 4-2 = 2 degrees of freedom. A reported "accuracy" tells us nothing without knowing the distribution of liars and sincere people in the test group..