Hacker News new | ask | show | jobs
by himata4113 5 days ago
No? You still pay for cache reads... Actually this is actually MORE expensive than just redoing prefill if your context is below 100k.