[Natsu]

I assume you mean that in the absolute sense, but one also has to realize that "cannot be measured" can also be a measure of our ability to measure things. So you certainly can have real effects that we're simply not able to measure.

And so in that sense, I'm not sure the premise follows, as some of the things we cannot measure are things like the conditions of the early universe, which certainly did effect[1] us.

[1] It affects us too, but I chose that word deliberately