Hacker News new | ask | show | jobs
by ryao 475 days ago
The cache hitrate is effectively 0 for LLMs since the datasets are so huge.