Hacker News new | ask | show | jobs
by forrest2 1153 days ago
You might not see it available via self serve interfaces, but I think the h100 cards can do 256x to a single host.
1 comments

You're right! You can nvlink 32 systems with 8 h100s! That's 20 terabytes of VRAM total!