Hacker News new | ask | show | jobs
by Y_Y 2 days ago
Eight B200s, at whatever quantization I can fit, ideally fp4. Apparently it might fit in eight H200s, but with 2.8B parameters (1.8% active) I'm not optimistic.