[chakademus]

Physicist here: the BICEP2 findings have a fair chance of being borne out, but I do feel that the BICEP group was a bit premature claiming definitive detection.

The doubts of independent groups, and the need for further experiments to confirm the results is the scientific method and community working as intended.

Ultimately, its mostly been the sensationalistic media coverage that makes the situation seem more controversial than it really is.

[darkmighty]

With the original announcement came a "five sigma" or so claim. Was that misleading or not? (was it plain wrong?) I mean, I'd expect from hearing something like that that unless the underlying theory changes the hypothesis is almost certainly true. Or is the uncertainty figure given in a more limited sense?

[betatim]

If you are making a systematic mistake (not necessarily an error, could also be an approximation that doesn't hold) in your analysis, the "5sigma" does not really take that into account.

Struggling to come up with a simple example. Imagine you collect some data, analyse it and see a "3sigma" effect. You decide to collect more data to see if the effect keeps getting bigger or goes away. After collecting a lot more data you get "5sigma". This could be because it is real, or because you have an "unknown unknown"

If you had a systematic (as oppose to a random effect) shift in your analysis, collecting more data will make you more sure that there is an effect. Even though all you are seeing is the effect of the systematic shift.

For almost all analyses in particle physics (or astro or ...) we spend a huge part of our time evaluating "systematics", it isn't uncommon that this part of the analysis takes a lot longer than the nominal result. Unfortunately this only protects you against known unknowns. You can't take into account things you don't think of/check for.

[choffstein]

I suppose if your estimator is biased and not consistent -- due to some sort of omitted variable -- you can end up with "significant" estimates that are completely removed from reality. Great explanation at http://eranraviv.com/blog/bias-vs-consistency/.

[nobbyclark]

But isn't it the case that anything we're capable of measuring here, given the relatively short available sample of data we'd be able to obtain (decades), would be inside any margin of error when comparing that to the age of the universe (13.8 billion years according to Big Bang)?

[nitrogen]

I don't see how it follows that we shouldn't be able to measure phase differences in the CMB just because the CMB is a lot older than our measurements.