Hacker News new | ask | show | jobs
by hobbified 142 days ago
I know this wasn't an entirely honest question, but yes, absolutely. You probably see Vimeo videos every day without realizing it, because most of the viewing isn't done on vimeo.com. It's videos on other sites, and the customers can pay to have their branding, not Vimeo's, so if you're buying something online and it has a product video... might be Vimeo. Or one of those websites that have big header splashes with full-video backgrounds. Or a subscription "channel" like Martha Stewart TV with mobile and smart-TV apps. Or a million other things.

Once at Vimeo, maybe 7 or 8 years ago, I was working on putting out the fires of an extremely weird operational issue where a bug in a cloud provider's software-defined networking stack led to corrupted HTTP responses, which got stored in CDN caches, causing persistent playback issues for users (playback not starting, or locking up in the middle). The cloud provider had reported it as a "packet loss" issue, because for the most part the misdirected packets would get rejected by the receiving TCP stack for having the wrong sequence number or whatever, but one time in a billion they would get through and wreak havoc... and we were moving enough traffic that those one-in-a-billion flukes were happening constantly.

I was musing in the shared chat with one of our CDN partners that, with no real way to tell what files were affected, the only way to fix the playback issues for everyone (short of waiting a month for all the cached objects to age out) would be to simply purge the whole cache. I immediately got a bold all caps DON'T EVEN THINK ABOUT DOING THAT in response. If we flushed the whole cache, the origin traffic to refill it would have saturated some internet links to the point of DoSing other customers and probably getting on CNN that evening. And that was then. Traffic levels got significantly higher later on.