This problem is going to get more severe as available datasets get bigger and bigger. The more data you have to mine, the more likely you are to find something that looks like a signal but isn't.
At some point, social science must switch to tighter p-value cutoffs and corrections for multiple comparisons. These are the norm in particle physics, which dealt with and resolved exactly this problem back in the 1970s.