Hacker News new | ask | show | jobs
by AndrewThrowaway 2133 days ago
Model | Easy | Medium | Hard

Mxnet | 96.5 | 95.6 | 90.4

Ours | 95.6 | 94.6 | 88.5

My professors would be so mad if I submitted data like this. I already can hear "What are the units? Seconds? So yours are by one second better? Error margin? Percent? So yours is worse?"

I get that this is a very specific information for a specific audience. People who stumble on this repo should know what is that.

However we can all be better at presenting our data.
2 comments
egocodedinsol 2133 days ago
It says mAP right above the table. If you know what mAP is then you know the units.

Professors will rail against imprecision to undergrads and young graduate students but they use it all the time in real life.

I can already hear my professors saying "stop commenting on style, what do you have to say about substance?"

link
stan_btd 2133 days ago
as stated in the repo, its "mAP result values"

https://medium.com/@jonathan_hui/map-mean-average-precision-...

link
AndrewThrowaway 2133 days ago
Don't get me wrong. I totally get it. But my professor is saying:

"So this is precision? 0 to 1? 1 being totally accurate? And you got 96.5? I assume it is percentage?"

link
nl 2133 days ago
It says "mAP result values on the WIDERFACE validation dataset:"

If your professor is working in on object detection they know what mAP is - all the major datasets use it as their standard evaluation criteria.

link
AndrewThrowaway 2133 days ago
So is it mAP of 0.956 or 95.6? Why not 956?
link
nl 2133 days ago
Not to be rude, but if you can't work that out you shouldn't be working on this. I'm sure the author would take a pull request, but but it really sounds like you are nitpicking.

Figures like precision and recall are often expressed either as 66% or 0.66. Confusion really isn't that big a problem.

link
AndrewThrowaway 2133 days ago
Not rude at all because I am totally nitpicking.

If you would write mAP: 0.9 or mAP (%): 90 or similar my "professor" would be OK with that.

I guess general rule in science (or maybe engineering) is to define units. I have no doubt that e.g. when you are building rockets (or maybe model airplanes) you would know that e.g. velocity is in m/s. Until somebody thinks in some other way and things blow up.

I just wanted to make some fun comment about missing units and that is it. I have no doubt that anybody browsing that repo would not be confused about mAP being 95.6.

link