Hacker News new | ask | show | jobs
by jtbaker 116 days ago
Ok, but prefill/prompt processing was definitely the weak point before. They were already solid in raw tokens/sec after TTFT