[davetannenbaum]

As someone working in this space, I largely agree with your take.

I'll only add that compared to, say, traditional economics we don't have a sense of how unique the problem is to social psych/organizational behavior. In the past decade psychology has done a lot more replication attempts and data auditing than have other fields in the social sciences. So it could be that other fields are equally problematic, but we don't know.

[huitzitziltzin]

This is a fair point. I would like to see more replications AND better incentives around replications.

FWIW... In plenty of economics papers you can't do a meaningful replication b/c there may be no analogous natural experiment. You can only do analysis of the same data. Such "replications" do not always lead to the same results.

The more experimental parts of the econ literature are now very big on pre-registration (esp. in development, e.g.). Not a panacea by any means, but an improvement for sure.

And there are generally higher standards around making code available now. If you work in this area and read the AER you may be aware of a recent retraction in PF due to coding malpractice. The system has improved but is far from perfect.

[davetannenbaum]

Yup, completely agree. I think research practices (and incentives for sound research practices) are starting to tilt in the right direction, though perhaps at a slower pace than I'd like.