Hacker News new | ask | show | jobs
Speculative Decoding: The Free Speed Toggle Your Local LLM Is Probably Not Using (vettedconsumer.com)
4 points by ermantrout 4 days ago