Hacker News new | ask | show | jobs
by legitster 24 days ago
> She probably will not publish this result because she thinks it is not interesting enough. Classic file-drawer problem in academic science.

It's truly insane that everyone in the academic class understands the fundamental problems of herding and sampling bias and yet every incentive is in place to do this.

3 comments

Having lived this reality, people respond to incentives. Your have to very fundamentally re-architect the incentives and career progression in academia to make publication of null results more common. The other side of this is reducing the time and hassle of publication. Right now I’m unlikely to battle for 1.5-3 years to get something through peer review for a result that nobody will find interesting.
I think this is exactly what the person you are replying to is saying; everyone knows it, but the people in charge of setting up the incentives still don’t seem interested in changing the incentives.
Yes, this has been my experience in the Australian academic system as well: everything is broken and nobody with the power to change it, cares.

China seems to make some strides for their own academics, thinking loudly about moving away from glam publications as career incentives: https://www.ft.com/content/64a811f1-b132-4211-8a8c-2252cf964...

It's supposedly about the worry of leaking state secrets, but it will have positive outcomes apart from that.

More devastating, the null results we would be really valuable with machines that can think. (Not humans that don't give a shit).
>people respond to incentives

Careful, you're starting to sound dangerously close to an Austrian economist!

[ ;) ]

"Show me the incentive and I'll show you the outcome." -- Charlie Munger
It's worse than that.

It wouldn't take much time for her to publish it then move on to something that looks good on a resumé, but it could actively work against her if she published something that doesn't substantiate the status quo. If you get labeled a science denier, because you published a negative result for a politically-charged subject, even when you agree with the overall cause, it'll be nearly impossible to get a job in the field, even with a flawless resumé.

I’m not sure who the academic class is (are grad students, postdocs, and tenured professors really in the same class?).

Anyway, the people setting the incentives are the ones handing out the grants.