Hacker News new | ask | show | jobs
by monkeybutton 1665 days ago
ML Engineer: Why does inference for this model take 0.9s per-call?!

Data scientist: I have no idea, inferences take 0.1s on average in my environment?

I jest but I've also lived this experience with data scientists developing an algorithm on Windows with one set of wheels, and the same code being deployed to Linux with a different set of binaries and the whole thing running 10x slower. We fixed it, but it was an unnecessary headache.