Hacker News new | ask | show | jobs
by reitzensteinm 308 days ago
OpenAI automatically caches prompt prefixes on the API. Caching an infrequently changing internally controlled system prompt is trivial by comparison.