But you can. Often it doesn't matter because you aren't a globally distributed cache, but if you are cloudflare[1] (or apparently Microsoft[2]), you can and do.
[1]: https://amp.cloudflare.com/
[2]: https://github.com/ampproject/amphtml/blob/master/caches.jso...