Hacker News new | ask | show | jobs
by vineyardmike 311 days ago
That’s not what prompt caching is.

Also, most ChatGPT users have their “personalization” prefix in the system prompt (which contains things like date/time), which would break caching of the actual user-query.