That is how it works.
"It’s worth repeating – Compliance Exports are not retroactive and do not apply to past private conversations before the feature is enabled."
I did not understand the sentence that way even after reading multiple times but that seems to make sense now. I must have been too biased when reading it before. Thank you for pointing this out.