Hacker News new | ask | show | jobs
by entrope 22 days ago
Those are the ratios for memory bandwidth, but the GPUs have a much higher ratio for compute, and that affects prefill rate / TTFT, right?