Hacker News new | ask | show | jobs
by maged 663 days ago
Why not? It's caching the state of the model after the cached prefix, so that inference workload doesn't need to be run again.