Hacker News new | ask | show | jobs
by erispoe 37 days ago
I have, mostly, long running autonomous tasks, so it doesn't matter how slow inference is. If I optimize for latency it means I'm turning into the limiting factor.