Hacker News new | ask | show | jobs
by yvdriess 1008 days ago
What do you mean with accuracy here? Usually 50% accuracy means cointoss, meaning 20% accuracy is equal to 80% accuracy, which is better than the article's 78% and not that far from 90%.
4 comments

> meaning 20% accuracy is equal to 80% accuracy,

Only if your model is outputting a yes/no answer right? And that your definition of accuracy is "class with highest probability" (and not "N classes with highest prob")

If your dataset has more than 2 classes like MNIST, a super low accuracy only tells you to ignore the class the model guesses. It doesn't tell you which of the remaining classes is correct

There are ten choices, so getting the answer right 20% of the time is very plausible.
"One simple trick to beat the statistical odds...."
There are 10 classes in Mnist. Random guess would is 10%.