Hacker News new | ask | show | jobs
by mzl 125 days ago
The cost of running things like prompt caching is defined by the implementation as that gives the infrastructure costs.