Pick your adversaries and scale your opsec accordingly. Unless you are a person of interest in national security matters, just the fact that you communicated with somebody does not incriminate you.