Hacker News new | ask | show | jobs
by _diq5 850 days ago
People are pretty cagey about what they use in production, but yes, speculative sampling can offer massive speedups in inference