I think that's because they used the original fake to make the deepfake. If they had used an actual actor (with a completely different face but accurate mouth movement) I think it would have been spot on.
That's been an issue for all CGI, I guess our ability to spot even the slightest imperfection in how mouths look has us well stuck in the uncanny valley