Hacker News new | ask | show | jobs
by iainmerrick 27 days ago
I can't see any information here about prompt caching (AKA prefix caching). That's absolutely required for any serious API usage with pay-per-token pricing. Anyone from Civo or relaxAI here able to clarify that? Thanks!