Hacker News new | ask | show | jobs
by throwaway314155 524 days ago
How are they going to double check without incurring the cost of running it again?
1 comments

Start with a regex (or fast tiny model) to flag obvious time-sensitive tasks. Else, do the task early by prompting it "if this requires up to the minute information, output cancel, else [prompt]". At best, it's 1 regex + 1 full inference. At worst, it's 1 regex + 1 output token + 1 full inference.