[huijzer]

Nevermind. I think I got it. My server name was set incorrectly so that

curl example.com/.well-known/matrix/client

responded with an incorrect base_url.