Hacker News new | ask | show | jobs
by awsanswers 338 days ago
Strongly agree with this approach. Real world task specific LLM query workloads tend to be long lived workflows. They should be brokered and handled rather than wait on.
1 comments

Thanks, glad it resonates :)