Hacker News new | ask | show | jobs
by bytesandbits 112 days ago
4x faster PREFILL not decode. Decode is bandwidth-bounded. Prefill is flops-constrained.