Hacker News new | ask | show | jobs
by olooney 2456 days ago
There are things like CONSORT[1] which kind of do this. Statisticians like Fisher[2] have a ton of good general advice of the design of experiments. (A plug for The Lady Tasting Tea[3] and the 7 Pillars of Statistical Wisdom[4] feels appropriate here.)

On the whole though, most of the things you should and should not do are so domain specific its very hard to give much useful advice at the level of "all science." Right now this seems to work because researchers are so eager to anticipate objections and and avoid unnecessary arguments during peer review they stick slavishly stick to the same methods used by seminal papers in their field, and this has the same effect as running down a checklist.

There probably is a case to be made for using an actual checklist, though[5].

[1]: http://www.consort-statement.org/

[2]: https://en.wikipedia.org/wiki/Design_of_experiments#Fisher's...

[3]: https://en.wikipedia.org/wiki/The_Lady_Tasting_Tea

[4]: https://www.goodreads.com/book/show/27311742-the-seven-pilla...

[5]: http://atulgawande.com/book/the-checklist-manifesto/