Hacker News new | ask | show | jobs
by Cr8 257 days ago
possible - but KV caches are generally _much_ bigger than the source text and can be reproduced from the source text so it wouldn't make a lot of sense to throw it out