[nils-m-holm]

That's what I meant: P(data | H0). So there is a 5% probability for the data to arise by chance (being noise) given H0 is true.

The whole terminology with values being "extreme" is just unintuitive and unwieldy, IMO.