[yjftsjthsd-h]

> We actually have an ongoing project to reduce the occurrence of these mistaken rejections by 90% by the end of this year. I think we’ll succeed at it. (They’re already down 50% since earlier this year.)

How can you tell? It seems, naively as an outsider, like the problem is precisely that you can't tell if they should have been rejected, in which case you can't tell how often it happens?

[pc]

Yeah, good question. First, we aren’t trying to calculate the absolute rate, just relative changes. (The absolute rate would be nice to know but it’s not needed to know whether we’re getting better or worse.) Methodologically, we sample/scrutinize rejections manually and also look at the occurrence of discovered false rejections. But you’re right that there could be some dark matter that we never become aware of.

[mdoms]

Well it looks like the Brains Trust inside Stripe has found a way to duke your OKRs, because this guy's appeal was denied and he was cut off anyway. No wonder your "incorrectly identified as fraud" metric is trending down if your staff are simply doubling down on incorrect accusations instead of copping them. Sounds like Goodhart's Law in action - do you happen to tie bonuses to OKRs?