Hacker News new | ask | show | jobs
by pklausler 475 days ago
There is caching today.
1 comments
ryao 475 days ago
The cache hitrate is effectively 0 for LLMs since the datasets are so huge.
link