Hacker News new | ask | show | jobs
by k2so 100 days ago
Yeah, for a single GPU inference, considering the higher VRAM and FP4 support on the RTX 6000, it should fit larger models as well than the H100.