Hacker News new | ask | show | jobs
by mrbnprck 21 days ago
Fixed :) Turned out to be a race condition where the groq inference task completed before the sse client could subscribe to that inference, and internally the sse connection couldn't be used to fetch already completed inferences.