Was that Codex/subsidised-usage or API? I do get overloaded in Codex-account from time to time, but API is rock solid.
They obviously load shed a bit of Codex-sub during peak times, and for the amount of tokens you get for a sub, I don't mind. I just mean the API where you pay-per-token is rock stable.
That’s what I was seeing too, and my cache hit rate was below 25% during that same time, leading to significant burn of my weekly limit (Pro 5x plan) via all the uncached input. Doesn’t prove that the overload caused the cache failure, but it does seem to point to some common infrastructure cause. No such problems (cache hit or system overload) with Terra or Luna.