Hacker News new | ask | show | jobs
by kevin_thibedeau 145 days ago
Catastrophic error accumulation can produce more profound effects than noise.
1 comments
measurablefunc 145 days ago
Just to make sure I got this right. They serve millions of requests a day & somehow catastrophic error accumulation is what is causing the 10% degradation & no one at Anthropic is noticing it. Is that the theory?
link
pertymcpert 135 days ago
FYI something in that region happened last august/September. Some inference bug triggered worse performance on TPUs vs GPU.
link