Hacker News new | ask | show | jobs
by gcr 24 days ago
Agreed. Prefill kills me for local model work. The model reads much faster than it writes, but I'd love to get a sense for how fast the model can read large source conversations.