Hacker News new | ask | show | jobs
by brianwmunz 61 days ago
PayPal benchmark is a smart way to launch this I think...showing real numbers on a recognizable API gives people something concrete to evaluate against. The 65% token reduction is probably the stat that'll matter most to teams watching API costs. One thing I'd be a little worried about is how this handles APIs that version aggressively or have breaking changes between major versions. The context packaging seems like it'd get complicated fast when you're maintaining accuracy across v1 and v2 of the same API simultaneously.