I would, yes. In fact, the Trump White House did just that, it’s right there in the thread. Without knowing what the tweets they had removed were, I don’t see evidence of wrongdoing. There are legitimate reasons to have tweets taken down: malicious impersonation, revenge porn (which apparently some of these were), death threats, etc.