Hacker News new | ask | show | jobs
by the_real_cher 21 days ago
I typed in a query and it just sat there for 30 seconds until i left the page
2 comments

Fixed :) Turned out to be a race condition where the groq inference task completed before the sse client could subscribe to that inference, and internally the sse connection couldn't be used to fetch already completed inferences.
sad