Hacker News new | ask | show | jobs
by pdyc 43 days ago
what bug and it affects what?
1 comments
verdverm 42 days ago
it's a prompt cache invalidation bug that causes all input to be reprocessed instead of getting preloaded

There are other reasons to prefer vllm to llama-cpp as well

link