Hacker News new | ask | show | jobs
by nightshift1 180 days ago
I think it would be even more wasteful to continue inference in background for nothing if the user decided to leave without pressing the stop button. Saving the partial answer at the exact moment the client disappeared would be better.
1 comments

What if I want to have the agent go off and work on something for a while and I'll check back tomorrow?