The API wasn't working perfectly, but with some retries we were able to change the config for our domains.